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Methods  for  the  design  of  predictive  controllers  for  uncertain  linear  systems  with 
guaranteed  closed-loop  stability  are  developed  as  well  as  conditions  for  robust  stability 
and  stabilization  of  bilinear  and  time-delay  systems  are  also  derived.  Specifically,  a 
systematic  technique  to  design  robust  predictive  controllers  for  unconstrained  linear 
systems  is  proposed  first.  The  robustified  controller  retains  the  servo  performance  of  a 
nominal  predictive  controller  designed  using  conventional  methods.  In  addition,  a  robust 
predictive  regulator  may  be  designed  to  guarantee  perfect  steady-state  rejection  of 
asymptotically  constant  disturbances.  The  robust  predictive  methodology  is  developed 
for  systems  affected  by  unstructured  uncertainty,  and  is  based  on  solving  a  discrete-time 
model-matching  problem.  It  is  shown  that  the  robustified  controller  can  be  classified  as  a 
predictive  controller  because  it  minimizes  the  same  performance  functional  as  its  nominal 
counterpart.  The  design  of  robust  predictive  controllers  for  a  second  order  unstable  plant 
illustrates  the  proposed  method. 

For  systems  that  are  subject  to  time-domain  constraints,  a  new  technique  for  the 
design  of  robust  predictive  regulators  is  proposed  based  on  mixed  l\IH^  theory.  The 
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controller  robustly  stabilizes  a  system  where  the  open-loop  plant  model  is  corrupted  by 
unstructured  uncertainty,  and  the  output  is  affected  by  bounded,  but  possibly  persistent 
exogenous  disturbances.  Adequate  nominal  performance  in  the  regulation  mode  is 
obtained  by  optimizing  an  /j  objective  that  minimizes  the  worst-case  amplification  of  the 
disturbance  signal.  Robust  stability  is  guaranteed  by  satisfying  frequency-domain 
conditions  through  an  problem.  The  resulting  constrained  predictive  regulator  design 
quantifies  the  achievable  limit  of  performance  with  respect  to  the  satisfaction  of  the  time- 
domain  constraints. 

Finally,  the  asymptotic  stability  and  stabilization  in  the  face  of  uncertainty  is 
examined  for  bilinear  and  time-delayed  plant  models.  A  variety  of  robust  stability 
conditions  is  derived  for  those  plants  in  the  last  several  chapters.  The  obtained  sufficient 
conditions  guarantee  the  stability  of  the  systems  under  state-feedback  control  in  the 
presence  of  a  norm-bounded,  nonlinear,  and  possibly  time-varying  uncertainty.  The 
effects  of  saturation  and  other  input  nonlinearities  are  examined,  and  finally  incorporated 
in  the  continuous-time  robust  stability  conditions.  The  method  makes  use  of  the  matrix 
measure  and  integrodifferential  inequalities  to  derive  the  robustness  conditions  as  a 
function  of  the  known  uncertainty  bounds.  A  characterization  of  the  domain  of  attraction 
is  given  in  the  case  of  uncertain  bilinear  systems. 

Suggestions  for  further  work  include  the  following:  investigate  other  recently 
proposed  mixed  optimization  approaches  to  predictive  regulator  design,  explore  further 
the  robust  stabilization  of  uncertain  bilinear  systems  with  time  delays  using  linear  or 
nonlinear  feedback  and  sliding-mode  control,  and  finally,  formulate  and  solve  the 
problem  of  designing  stabilizing  predictive  controllers  for  bilinear  constrained  process 
models. 
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CHAPTER  1 

ROBUST  CONTROL— THE  COMMON  THEME  OF  THIS  DISSERTATION 


1.1  Motivation 

The  ultimate  goal  in  control  system  design  is  to  build  a  controller  that  will  satisfactorily 
perform  in  the  non-ideal  environment.  Because  the  real  environment  may  change  with  time 
or  operating  conditions  may  vary  (disturbances),  the  control  system  should  be  able  to 
withstand  such  variations.  Even  when  the  environment  does  not  change,  the  quality  of  the 
model  on  which  the  design  is  based  is  of  concern.  The  mathematical  representation  of 
physical  systems  often  involves  simplifications,  if  not  wishful  assumptions.  Nonlinearities 
may  be  unmodeled  or  modeled  but  ignored  later  to  simplify  the  analysis.  Also,  different 
components  of  the  system  such  as  actuators,  sensors,  etc.  have  dynamics,  but  frequently 
they  are  modeled  as  constant  gain  systems.  The  issue  of  uncertainty  in  control  system 
design  is  therefore,  of  fundamental  importance,  as  is  attested  by  numerous  reports  on  the 
modeling  and  control  of  uncertain  systems. 

The  property  that  a  control  system  must  possess  in  order  to  operate  properly  in  realistic 
situations  (where  uncertainty  is  prevalent)  is  called  "robustness".  This  means  that  the 
compansator  must  perform  satisfactorily  not  just  for  one  "nominal"  plant  but  for  a  family  of 
plants  described  in  the  time  or  the  frequency  domain.  Thus,  the  Robust  Control  problem  is 
roughly  that  of  analyzing  and  designing  accurate  control  systems  given  plants  which 
contain  significant  uncertainty.  To  define  the  problem  more  precisely,  a  number  of 
problem  elements  must  be  carefully  developed.  In  particular  one  should  delineate  the  class 
of  plant  models,  uncertainty  models,  and  performance  measures  that  are  to  be  considered. 
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1.1.1  Plant  Models 

There  are  three  common  hnear  multivariable  plant  models  used  in  the  literature;  they 
are  state-space  models,  transfer-function  matrix  models,  and  matrix-fraction  models.  The 
state-space  or  state-variable  models  are  generally  written  in  the  form 


where  x,y,  and  uaren,  p  and  q  dimensional  state,  output,  and  input  vectors,  respectively. 
The  transfer-function  matrix  models  are  denoted  G(s),  where  G(s)  is  ap  xq  matrix,  with 
entries  made  up  of  rational  functions  in  the  complex  Laplace  transform  variable  s,  and  G( s) 
relates  the  transform  of  the  input  vector  u  to  the  transform  of  the  output  vector  Finally, 
matrix-fraction  models  are  of  the  form,  for  example  for  a  right-coprime  fraction,  G( s)  = 
N(s)D'^(s),  where  N(s)  and  D(s)  are  matrices  with  either  polynomial  entries  or  stable 
rational-  function  entries. 

1.1.2  Plant-Uncertainty  Models 

Each  plant  model  requires  its  own  type  of  uncertainty  model.  In  addition,  uncertainty 
is  characterized  in  a  number  of  different  ways.  For  example,  uncertainty  is  characterized  as 
parametric  versus  nonparametric,  structured  versus  unstructured,  and  stochastic  versus 
deterministic  (set  uncertainty).  To  illustrate  the  different  types  of  uncertainty,  consider  the 
state-space  model  (1.1).  The  uncertainty  in  the  term  such  as  Ax  can  be  modeled  as 
follows: 

{i)Ax  — >(A  +  8A)x,  where  8A  is  constrained  only  in  norm,  i.e.  \\5A  II  <  a. 


X  =Ax+  Bu,  y  =  Cx+  Du 


(1.1) 


(Hi)  Ax  ^  Ax  +  y,  J^,G,vv  where  vv  is  a  white  noise  random  process. 
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In  this  case,  (/)  and  (//)  represent  parametric  set-uncertainty  models,  whereas  in  (/),  the 
uncertainty,  represented  by  5A,  is  unstructured,  and  where  in  (//),  the  uncertainty, 
represented  by  r,  is  structured.  Essentially,  structured  uncertainty  limits  how  the 
uncertainty  enters  into  the  matrix  A.  In  (///),  the  uncertainty  is  modeled  stochastically,  as  a 
multiplicative  white  noise  process  vv.  Examples  of  the  use  of  the  models  in  (i)  and  (//)  may 
be  found  in  Doyle,  et  al.  (1992),  and  Weinmann  (1991),  and  the  model  in  {Hi)  in  Wonham 
(1967). 

For  the  transfer-function  matrix  model,  uncertainty  in  the  transfer  matrixG  may  be 
modeled  as  follows 

(/v)  G^(I  +  L)G,  where  II  LO'fO)  H  <  L(co) 

(v)  G^G(I  +  L),  where  II  L(jco)  II  <  U(o) 

(vi)  G^G+dG,  where  ll<5G  II  <  4(«). 

In  the  formulas  above,  II  L(jco)  II  denotes  the  norm  of  the  matrix  L.  In  (iv)  and  (v),  L 
represents  multiplicative  unstructured  nonparametric  uncertainty  at  the  plant  output  and 
input,  respectively.  For  multivariable  systems,  the  location  of  multiplicative  perturbations 
is  critical,  because  matrix  products  do  not  in  general  commute.  In  {vi),  5G  represents 
additive  unstructured  nonparametric  uncertainty.  Uncertainties  of  these  types  are  discussed 
extensively  in  Doyle  and  Stein  (1981),  and  Doyle,  et  al.  (1992).  If  only  certain  elements  of 
L  and  dG  are  variable,  the  uncertainty  would  then  be  structured.  An  important  advantage 
of  nonparametric  models  is  that  they  permit  the  treatment  of  uncertainty  associated  with 
unmodeled  dynamics.  Thus  for  example,  L  in  {iv)  may  be  a  rational  matrix  of  degree 
higher  than  G. 

Uncertainty  in  the  plant  model  may  have  several  origins: 

1.  There  are  always  parameters  in  the  linear  model  which  are  only  known 
approximately  or  are  simply  in  error. 
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2.  The  parameters  in  the  hnear  model  may  vary  due  to  nonhnearities  or  changes 
in  the  operating  conditions. 

3 .  At  high  frequencies,  even  the  structure  and  the  model  order  is  unknown,  and 
the  uncertainty  will  always  exceed  100%  at  some  frequency. 

4.  Measurement  devices  have  imperfections.  This  may  even  give  rise  to 
uncertainty  in  the  manipulated  inputs,  since  the  actual  input  is  often  measured  and 
adjusted  in  a  cascade  manner.  For  example,  this  is  often  the  case  with  valves 
used  to  measure  flow.  In  other  cases,  limited  valve  resolution  may  cause  input 
uncertainty. 

5 .  Even  when  a  very  detailed  model  is  available,  we  may  choose  to  work  with  a 
simpler  (low-order)  nominal  model  and  represent  the  neglected  dynamics  as 
"uncertainty". 

6.  Finally,  the  implemented  compensator  may  differ  from  the  one  obtained  by 
solving  the  synthesis  problem.  In  this  case,  one  may  include  uncertainty  to  allow 
for  controller  order  reduction  and  implementation  inaccuracies. 

Uncertainty  in  matrix-fraction  models  is  not  considered  in  this  dissertation.  Some 
discussion  of  this  type  of  uncertainty,  where  N(s)  and  D(s)  are  additively  perturbed, 
appears  in  Vidyasagar  (1985).  There  are  many  ways  to  define  uncertainty  from  stochastic 
uncertainty  to  differential  sensitivity  and  multi-models.  Weinmann  (1991)  gives  a  good 
overview. 

1.1.3  Performance  Measures 

Control  systems  are  designed  to  meet  certain  performance  requirements.  These  are 
quantified  using  different  indices  depending  on  the  approach  followed.  Of  course,  stability 
is  often  an  implicit  performance  measure  in  control  system  design.  In  addition,  however, 
other  measures  are  often  required,  relating  typically  to  tracking  errors,  disturbance 
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rejection,  and  noise  suppression.  The  most  common  mathematical  forms  for  performance 
measures  are 


The  measures  given  by  (/)  -  (///)  are  referred  to  as  the  integral  quadratic  measure,  //^-norm 
measure,  and  //j-norm  measure,  respectively.  In  (//)  and  (///),  the  vector  e  represents  an 
"error"  vector  which  is  to  be  kept  as  small  as  possible.  Because  of  the  plant  uncertainty, 
one  can  at  best  minimize  an  upper  bound  on  these  performance  measures,  or  in  the 
stochastic  case,  an  average  value.  Cases  where  ||eO'6t))|  is  bounded  at  each  frequency 
point,  that  is,  <  l^ioi)  can  be  reduced  to  a  normalized  design  condition  of  the  form 


which  is  of  the  //^-norrn  type  measure.  Designs  which  minimize  an  upper  bound  are 
referred  to  as  guaranteed-cost  designs,  while  those  that  minimize  the  least-upper-bound  are 
called  minimax  designs.  Some  good  introductory  material  for  single-input  single-output 
systems  design  with  these  norms  can  be  found  in  Youla,  et  al.  (1976),  and  Zames  and 
Francis  (1983). 

It  is  meaningful  however,  to  assess  quantitatively  the  performance  of  the  system  under 
control  only  if  its  stability  can  be  assured.  Otherwise,  the  trajectories  of  the  system  under 
admissible  operating  conditions  may  "blow  up",  thus  rendering  the  system  useless. 
Hence,  stability  is  the  most  fundamental  requirement  in  control  system  design.  Motivated 
by  this  observation,  design  methods  for  controllers  that  guarantee  closed-loop  stability  in 
the  face  of  uncertainty  are  sought  in  this  dissertation.  The  approach  is  different  depending 


(//)  7  =  sup„||e(;ffl)|| 
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on  whether  the  plant  model  is  linear  or  bilinear.  First,  a  design  methodology  for  robust 
predictive  controllers  for  unconstrained  processes  is  developed.  Then,  we  should  extend 
the  approach  to  design  predictive  regulators  for  uncertain  linear  systems  subject  to  input  or 
output  constraints.  After  this,  stability  in  the  face  of  uncertainty  is  studied  for  bilinear  and 
time-delayed  plant  models.  A  variety  of  robust  stability  conditions  for  those  systems  is 
derived  depending  on  the  structure  of  the  system,  the  kind  of  uncertainty  characterization, 
and  the  existence  or  not  of  constraints  or  nonlinearities  in  the  input  channel. 

1.2  Objectives 

Design  techniques  for  predictive  controllers  that  guarantee  the  stability  of  uncertain 
linear  plants  are  developed  in  this  dissertation.  Also,  the  stability  of  uncertain  bilinear  or 
time-delay  systems  with  saturating  actuators  or  other  input  nonlinearities  is  examined  and 
sufficient  robust  stability  conditions  are  derived.  The  development  of  the  subject  is 
outlined  in  section  1.3.  Before  that,  the  basic  areas  upon  which  this  dissertation  builds  are 
briefly  discussed. 

1.2.1  Predictive  Control 

The  name  Predictive  Control  describes  a  class  of  computer  control  schemes  that  utilize 
a  process  model  for  the  following  tasks: 

1 .  To  explicitly  predict  the  future  plant  behavior. 

2 .  To  calculate  an  appropriate  control  action  necessary  to  drive  the  predicted  output 
as  close  as  possible  to  the  desired  value. 

Predictive  control  techniques  offer  good  performance,  and  are  easy  to  understand  and 
formulate.  They  have  the  ability  to  handle  time  delays,  difficult  process  dynamics,  and  can 
accommodate  process  constraints  (Ogunnaike  and  Ray,  1994).  For  these  reasons,  they 
have  been  popular  in  the  chemical  process  industries  (Seborg,  1994).   Despite  their 
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popularity  though,  there  still  remain  challenges  where  more  research  effort  is  needed. 
Robust  stability  conditions  for  example,  have  been  derived  only  for  certain  approaches 
where  the  open-loop  plant  is  assumed  to  be  stable.  Several  of  the  predictive  control 
strategies  contain  a  substantial  number  of  tuning  parameters,  and  it  is  not  always  obvious 
how  these  parameters  should  be  chosen.  In  contrast,  this  dissertation  offers  a  design 
methodology  that  includes  open-loop  unstable  plants,  guaranteeing  robust  stability  through 
the  calculation  of  a  single  transfer  function  (the  Youla  parameter  Q)  in  a  systematic  fashion. 
A  predictive  regulator  strategy  is  also  developed  for  uncertain  linear  plants  in  the  presence 
of  constraints  using  the  recently  developed  li/Hoo  framework. 

1.2.2  Bilinear  Systems 

As  an  approximation  to  the  nonlinear  plant  behavior,  a  bilinear  model  can  often 
provide  a  more  accurate  representation  than  a  linear  system.  Furthermore,  a  bilinear  model, 
being  linear  in  the  states  and  linear  in  the  control  variables  but  not  jointly  linear,  presents  a 
more  tractable  form  than  a  full-scale  nonlinear  model.  Bilinear  models  are  also  easier  to 
obtain  through  an  identification  process  than  fully  nonlinear  models.  For  the  above 
reasons,  they  have  been  studied  extensively  over  the  past  two  decades.  However,  the 
problem  of  stabilization  of  bilinear  systems  when  the  model  is  uncertain  has  not  received 
much  attention.  We  set  out  therefore  to  derive  robust  stability  conditions  for  bilinear 
systems  that  are  uncertain  and  moreover  subject  to  actuator  saturation.  A  state  feedback 
approach  is  employed  and  the  useful  properties  of  matrix  norms  and  matrix  measure  are 
utilized. 

1.2.3  Time-Delay  Systems 

In  many  applications,  it  is  often  assumed  that  the  system  under  consideration  is 
governed  by  a  principle  of  causality;  that  is,  the  future  state  of  the  system  is  independent  of 
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the  past  states  and  is  determined  solely  by  the  present.  If  it  is  also  assumed  that  the  system 
is  governed  by  an  equation  involving  the  state  and  rate  of  change  of  the  state,  then 
generally,  one  is  considering  either  ordinary  or  partial  differential  equations.  However, 
under  closer  inspection,  it  becomes  apparent  that  the  principle  of  causality  is  often  only  an 
approximation  to  the  true  situation,  and  that  a  more  realistic  model  would  include  some  of 
the  past  states  of  the  system.  In  other  problems  also,  it  is  meaningless  not  to  have  some 
dependence  on  past  variables.  This  has  been  known  for  some  time,  but  the  theory  for  such 
systems  has  been  extensively  developed  only  recently  (Hale  and  Lunel,  1993).  In  the 
process  industries,  one  often  finds  systems  in  which  there  is  a  noticeable  delay  between  the 
time  instant  the  input  change  is  implemented  and  when  the  effect  is  observed,  with  the 
process  output  displaying  an  initial  period  of  no  response.  Such  systems  are  appropriately 
referred  to  as  time-delay  systems,  and  "their  importance  is  underscored  by  the  fact  that  a 
substantial  number  of  processes  exhibit  delay  characteristics"  (Ogunnaike  and  Ray,  1994, 
p.245).  Recognizing  the  importance  of  time-lags,  and  recalling  the  common  theme  of  this 
dissertation,  that  is,  robustness,  the  stability  of  uncertain  time-delay  systems  is  treated  to  a 
considerable  extent.  A  host  of  robust  stabilizability  and  robust  stability  conditions  are 
derived  for  different  configurations  of  the  plant  model.  These  include  a  class  of  uncertain 
bilinear  systems  with  state  delay  that  may  also  be  uncertain,  and  uncertain  linear  delayed 
models  with  saturation  or  other  nonlinear  effects. 

1.3     Organization  of  the  Dissertation 

The  dissertation  is  organized  into  seven  chapters  as  follows.  Chapter  1  contains 
introductory  material  and  ideas  used  in  subsequent  chapters.  In  Chapter  2,  we  discuss  the 
design  of  unconstrained  robust  predictive  controllers.  Chapter  3  clearly  defines  and  solves 
the  robust  predictive  regulator  problem  subject  to  input  constraints.  Chapter  4  derives 
sufficient  condiUons  for  the  robust  stabilization  of  input-constrained  bilinear  systems.  In 
Chapter  5,  the  methodology  developed  in  Chapter  4  is  extended  to  include  time  delays  in 


the  state  variables.  Chapter  6  derives  delay-dependent  robust  stability  conditions  for 
uncertain  linear  systems  with  application  to  CSTRs  with  recycle.  Finally,  Chapter  7 
contains  proposals  for  future  work  and  possible  extensions  of  the  material  presented  in  this 
dissertation. 

Specifically,  a  systematic  technique  to  design  robust  predictive  controllers  for  linear 
systems  is  proposed  in  Chapter  2.  The  approach  consists  of  parametrizing  a  nominal 
predictive  controller  which  is  designed  using  conventional  methods.  A  significant  feature 
is  the  use  of  a  ^-parameterization  technique  that  preserves  the  servo  dynamics  of  the 
nominal  controller.  The  method  is  applicable  to  unconstrained  predictive  control  designs 
that  use  transfer-function  models  corrupted  by  unstructured  uncertainty.  It  is  also  shown 
how  to  incorporate  an  integrator  in  the  robust  controller,  enhancing  the  closed  loop 
performance  by  guaranteeing  steady-state  rejection  of  asymptotically  constant 
disturbances. 

In  Chapter  3,  the  focus  is  on  robust  regulation  in  the  presence  of  input  or  output 
constraints.  The  predictive  control  technique  developed  in  Chapter  2  is  extended  to 
encompass  persistent  but  bounded  disturbances  and  process  constraints.  Utilizing  recently 
developed  extensions  of  robust  linear  control  theory,  the  problem  of  robust  predictive 
regulation  in  the  presence  of  constraints  is  formulated  as  a  mixed  l\/H^  optimization.  An 
example  using  an  unstable  plant  illustrates  the  results  and  shows  the  achievable  limits  of 
performance  with  a  linear  controller.  A  discussion  on  the  order  of  the  controllers  obtained 
is  also  included. 

Chapter  4  concentrates  on  stabilization  of  input-constrained  uncertain  bilinear  systems. 
A  state-feedback  controller  is  used  to  stabilize  a  continuous-time  bilinear  system  with 
constant  system  matrices  and  subject  to  actuator  saturation.  Sufficient  conditions  are 
derived  that  guarantee  the  stability  of  the  saturating  nonlinear  system  in  the  presence  of 
norm-bounded  perturbations.  Two  different  uncertainty  descriptions  are  employed, 
namely,  a  nonlinear  bounded  perturbation,  and  linear  bounded  perturbations  on  the  system 
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matrices.  Examples  are  also  given  at  the  end  of  the  chapter  that  illustrate  the  procedure  and 
the  simplicity  of  the  derived  conditions. 

Chapter  5  extends  the  findings  of  Chapter  4  to  address  the  robust  asymptotic 
stabilization  of  a  class  of  bilinear  systems  with  delays  in  the  state  variables.  Sufficient 
conditions  are  derived  to  guarantee  the  stability  of  the  time-delay  system  in  the  presence  of 
norm-bounded  nonlinear  uncertainties.  Use  is  made  of  the  matrix  measure  to  yield  a 
general  robust-stability  condition  and  a  characterization  of  the  associated  domain  of 
attraction  for  the  nonlinear  system. 

In  Chapter  6,  the  stabilization  of  a  model  of  an  integrated  reactor/separator  module 
with  recycle  is  studied,  and  robust  stability  conditions  are  derived.  Linear  time-delay 
models  are  employed  with  system  nonlinearities  appearing  in  two  different  terms:  the  first 
term  includes  perturbations  which  are  allowed  to  be  nonlinear  and/or  time- varying,  and  the 
second  term  represents  nonlinearities  in  the  input  channel.  The  latter  class  includes  input 
saturation  as  a  special  case.  The  key  observation  in  this  chapter  is  that  nonlinearities  and 
plant  uncertainty  may  destabilize  an  otherwise  stable  time-delay  system.  A  detailed  model 
of  a  CSTR  with  recycle  stream  is  used  as  an  example  to  demonstrate  the  results. 

Finally,  Chapter  7  contains  suggestions  for  further  work. 


CHAPTER  2 

UNCONSTRAINED  ROBUST  PREDICTIVE  CONTROL  DESIGN 

2.1  Introduction 

Predictive  control  strategies  have  received  much  attention  in  the  literature  and  have  also 
found  acceptance  in  industry.  The  popularity  of  these  methods  is  due  to  the  fact  that  they 
offer  good  performance,  are  easy  to  understand  and  formulate,  and  can  accommodate 
input/output  process  constraints.  The  industrial  success  of  the  predictive-control 
techniques  is  apparent  by  the  variety  of  commercial  predictive  controllers  that  are  available 
to  the  chemical  processing  industry  through  specialized  vendors.  In  fact,  predictive  control 
is  possibly  the  most  widely  utilized  model-based  control  strategy  in  the  chemical  industry, 
and  is  often  the  only  model-based  control  technique  supported  and  offered  commercially  by 
control  engineering  companies.  Seborg  (1994)  reports  that  in  oil  refineries  and 
petrochemical  plants  around  the  world,  there  are  hundreds,  perhaps  thousands,  of 
predictive  controllers  employed. 

It  is  possible  to  design  predictive  controllers  using  different  plant  representations.  One 
common  approach  is  to  use  finite  impulse-response  models  (FIR).  This  is  the  favored 
approach  in  the  earlier  formulations,  including  Dynamic  Matrix  Control  (DMC)  (Cutler  and 
Ramaker,  1980),  Model  Algorithmic  Control  (Mehra,  et  al,  1979),  and  the  quadratic  DMC 
formulation  of  Garcia  and  Morshedi  (1986).  An  extensive  review  of  FIR-based  predictive 
control  is  given  by  Garcia,  et  al.  (1989).  The  FIR  methods  are  applicable  only  to  stable 
plants,  and  often  require  large  model  orders,  typically  retaining  30  to  40  impulse  response 
coefficients.  An  alternative  approach  is  to  base  the  controller  design  on  transfer-function 
models,  which  are  applicable  to  both  stable  and  unstable  plants,  and  lead  to  lower-order 
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representations.  Examples  of  transfer-function  based  predictive  control  are  the  well-known 
Generalized  Predictive  Control  (GPC)  technique  (Clarke,  et  al,  1987)  and  the  MUSMAR 
approach  (Greco,  et  al,  1984).  A  third  approach  is  the  use  of  state-space  methods  for 
predictive  control  design,  a  practice  that  has  an  early  representative  in  the  work  of  Kwon 
and  Pearson  (1977),  and  has  recently  gained  popularity  through  multiple  advocates  such  as 
the  work  of  Muske  and  Rawlings  (1993a).  This  large  body  of  literature  constitutes  a  rich 
source  of  knowledge  to  support  the  design  and  analysis  of  predictive  controllers. 

Currently,  there  is  an  increasingly  visible  interest  in  the  research  community  to  revisit 
the  predictive  control  design  techniques  with  the  intention  of  including  robustness  features 
that  guarantee  stability  or  adequate  performance  when  the  plant  model  is  uncertain.  One 
interesting  example  is  the  robust  quadratic  DMC  design  including  hard  constraints  studied 
by  Zafiriou  (1990).  The  author  uses  a  contraction  mapping  first  proposed  by  Economou 
(1985)  to  successfully  derive  time-domain  conditions  for  robust  stability  with  respect  to 
uncertainty  in  the  impulse-response  coefficients  of  the  nominal  model.  Unfortunately,  this 
approach  may  lead  to  conservative  designs,  and  is  not  of  practical  utility  because  it  involves 
a  very  large  numerical  computation  effort.  More  recently,  Genceli  and  Nikolaou  (1993) 
proposed  an  analysis  and  synthesis  method  for  predictive  controllers  based  on  FIR  models, 
including  constraints  and  using  a  linear  cost  functional,  instead  of  the  classical  quadratic 
functional.  These  authors  use  a  parametric  model  uncertainty  description  that  bounds  the 
maximum  deviations  allowed  for  each  pulse-response  coefficient,  and  obtain  a  sufficient 
condition  for  robust  closed-loop  stability. 

The  robustness  of  predictive  controllers  designed  using  transfer-function 
representations  is  receiving  increasing  attention  in  the  literature.  Kouvaritakis,  et  al.  (1992) 
propose  an  alternative  approach  to  GPC  that  employs  an  additional  compensator  that 
stabilizes  the  plant  before  the  predictive  design  is  carried  out.  These  authors  make  use  of 
the  !2-parametrization  procedure  popularized  by  Youla  (Youla,  et  al,  1976)  as  the  basis  for 
a  scheme  that  robustifies  the  controller  with  respect  to  unstructured  perturbations.  The 
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authors  state  rigorous  necessary  and  sufficient  conditions  for  robust  stability;  however,  the 
approach  proposed  for  synthesizing  robust  controllers  is  an  approximate  albeit  practical 
scheme.  The  method  consists  of  using  polynomial  or  fixed-order  transfer  function 
approximations  for  the  Youla  parameter,  and  least-squares  methods  to  identify  the 
parameters  of  the  robust  design.  Robinson  and  Clarke  (1991)  analyzed  the  robustness  of 
the  GPC  technique  in  an  indirect  fashion.  They  investigated  two  particular  control  designs, 
namely,  a  dead-beat  and  a  mean-level  controller,  which  can  be  interpreted  as  special  cases 
of  GPC  that  arise  for  specific  tuning  parameters.  The  focus  is  on  the  effect  of  a  polynomial 
prefilter  T  proposed  by  the  authors  to  introduce  stability  robustness.  The  analysis  is  not 
strictly  valid  for  any  other  choices  of  predictive-control  tuning  parameters,  nor  for  the  case 
of  unstable  plants.  In  a  recent  publication,  Yoon  and  Clarke  (1995)  compare  designs  based 
on  r-filtering  and  on  Q-parametrization,  and  propose  simple  guidelines  for  robust  synthesis 
using  the  T  polynomials.  A  representative  approach  to  robust  control  of  constrained 
nonlinear  systems  in  continuous  time  is  reported  in  Michalska  and  Mayne  (1993). 

This  chapter  presents  a  systematic  procedure  for  robustifying  predictive  controllers  in 
the  presence  of  unmodeled  dynamics.  A  nominal  predictive  controller  designed  using  the 
nominal  plant  model  is  parametrized  to  produce  a  robust  predictive  controller  that  ensures 
stability  with  respect  to  the  uncertainty  in  the  nominal  model,  and  guarantees  adequate 
performance.  Given  that  so  much  knowledge  is  currently  available  for  designing  and 
tuning  high-performance  predictive  controllers  for  the  case  where  the  plant  model  is 
assumed  to  be  free  of  uncertainty,  it  is  of  fundamental  importance  that  the  robustified 
controller  be  able  to  preserve  the  performance  of  the  nominal  controller.  Specifically,  in  the 
limit  when  the  uncertainty  in  the  plant  model  is  negligible,  the  servo  performance  of  the 
robust  predictive  controller  should  closely  resemble  the  tracking  behavior  of  the  nominal 
predictive  controller.  Furthermore,  in  its  role  as  a  regulator,  the  robustified  predictive 
controller  must  be  able  to  reject  the  effect  of  asymptotically  constant  perturbations. 
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The  proposed  approach  consists  of  parametrizing  a  nominal  predictive  controller  which 
is  designed  using  conventional  and  well  established  methods.  A  significant  feature  is  the 
use  of  a  Q-parametrization  technique  that  preserves  the  servo  dynamics  of  the  nominal 
controller.  The  method  is  applicable  to  unconstrained  predictive  control  designs  that  use 
transfer-function  plant  models  corrupted  by  unstructured  uncertainty.  A  solution  to  the 
robust  design  problem  is  obtained  using  an  algorithm  by  Rotstein  and  Sideris  (1992)  that 
yields  an  explicit  solution  to  an  underlying  Nehari  extension  problem.  Therefore,  the 
technique  avoids  the  use  of  approximations,  yet  remains  practical.  The  design  also  has  the 
advantage  of  being  able  to  include  an  integrator  in  the  robust  controller,  hence  enhancing 
the  closed  loop  performance  properties  by  guaranteeing  steady-state  rejection  of 
asymptotically  constant  disturbances. 

The  chapter  is  organized  as  follows.  Section  2  presents  a  concise  review  of  the  design 
equations  for  a  nominal  predictive  controller,  including  the  resulting  control  law,  in 
transfer-function  form.  Section  3  derives  a  necessary  and  sufficient  condition  for  robust 
stability,  and  Section  4  develops  a  comprehensive  methodology  for  synthesizing  robust 
predictive  controllers.  A  design  example  is  given  in  Section  5,  followed  by  final 
conclusions  offered  in  Section  6. 

2.2     Nominal  Predictive  Controller  Design 

The  design  of  nominal  predictive  controllers  is  vastly  documented  in  the  hterature.  In 
particular,  a  wealth  of  knowledge  is  available  to  resolve  crucial  design  issues  such  as 
nominal  closed-loop  stability,  and  parameter  tuning  (Lambert,  1987;  Mohtadi,  1987). 
Typically,  predictive  controllers  are  employed  by  executing  at  every  sampling  instant  an 
algorithm  that  solves  a  quadratic  optimization  problem.  For  analysis  purposes,  it  is 
desirable  to  represent  the  algorithmic  controller  in  terms  of  transfer  functions,  thus  allowing 
the  utilization  of  classical  z-domain  tools  for  analyzing  stability  and  performance.  This 
section  presents  a  brief  review  of  the  analysis  technique  discussed  by  Crisalle,  et  al. 
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(1989),  which  casts  an  algorithmic  predictive-control  law  of  the  GPC  type  into  a  form 
involving  transfer-function  operators.  The  resulting  nominal  controller  is  used  later  as  the 
basis  for  the  design  of  a  robust  controller. 
Consider  the  nominal  process  model 

A(z)y(z)  =  B(z)u(z)  (2.2.1) 
where  y(z)  and  u(z)  are  the  process  output  and  input,  respectively,  and  A(z)  and  B(z)  are 
the  coprime  polynomials 

(2.2.2) 

Aiz)  =  z"+a,,_,z"-'+...  +  a, 

B{z)  =  b„,z"'+b,„_,z"'-'+...  +  b,  (2.2.3) 
of  order  n  and  m,  respectively,  where  n>m.  Predictive  control  involves  the  minimization 
of  the  quadratic  cost  functional 

Jit)  =  J^[rit  +  i)  -  yit  +  i\t)f  +  ^f^[Auit  +  of  (2-2.4) 

i=l  1=0 

where  {r(t+i)}  is  the  sequence  of  future  values  of  the  set  point,  {y(t+i\t)}  is  the  sequence 
of  predicted  future  values  of  the  output,  {Au(t+i)}  is  the  sequence  of  future  control 
increments,  A  is  the  move-suppression  parameter  used  to  penalize  excessive  control 
energy,  and  parameters  A^^,  and  are  the  prediction  and  control  horizons,  respectively. 
By  definition,  a  predictive  control  law  is  an  algorithm  that  at  every  sampling  instant 
produces  the  control  move  u(t)  that  minimizes  the  functional  (2.2.4)  for  the  prescribed  set 
point  sequence  { r(t) } .  The  optimal  control  move  is  naturally  found  by  differentiating 
(2.2.4)  with  respect  to  the  control  moves,  equating  the  result  to  zero,  and  solving  for  u( t). 
Following  the  development  by  Crisalle,  et  al.  (1989),  it  is  possible  to  write  the  resulting 
control  law  in  terms  of  transfer-function  operators  in  the  form 

^uiz)  =  T(z)r(z)-^y(z) 
z  z  (2.2.5) 

which  includes  the  polynomial  operators 
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(2.2.6) 


S(z)  =  s„z"+s„_,z''-'+...  +  s, 


'0 


(2.2.7) 


(2.2.8) 


where 


R(1)  =  0 


(2.2.9) 


and 


T(1)  =  S(1) 


(2.2.10) 


and  where  the  coefficients  of  the  moving-average  polynomial  S(z),  the  regressor 
polynomial  R(z),  and  the  set-point  advancement  polynomial  T(z)  are  functions  of  the  tuning 
parameters  A^^„  A^„,  and  A,  and  of  the  model  polynomials  A(z)  and  B(z).  Note  that  (2.2.9) 
implies  that  the  predictive  control  law  (2.2.5)  includes  an  integrator.  A  block-diagram 
representation  of  the  predictive  control  structure  is  shown  in  Figure  2- la.  Specific  design 
equations  for  the  polynomials  (2.2.6)  -  (2.2.8)  are  given  in  Section  2.6;  further  details  of 
the  derivation  can  be  found  in  Crisalle,  et  al.  (1989).  A  formulation  equivalent  to  (2.2.5)  is 
also  derived  in  Mcintosh,  et  al.  (1991). 

Note  that  the  transfer  functions  operating  on  u(z)  and  y(z)  in  the  nominal  predictive 
controller  (2.2.5)  are  of  order  n,  the  order  of  the  nominal  plant  model.  It  is  also  significant 
to  note  that  the  set-point  advancement  polynomial  l(z)  is  of  degree  equal  to  the  prediction 
horizon  A^^,.  Since  N^,  >  n  is  a  common  tuning  prescription  (Clarke,  et  al,  1987),  the 
order  of  T(z)  may  exceed  the  order  of  Rfzj,  making  the  control  law  nonproper  (noncausal) 
with  respect  to  the  set-point  signal.  This  noncausality  is  a  natural  consequence  of  the 
inclusion  of  future  values  of  the  set  point  in  (2.2.4).  Figure  2- la  shows  that  T(z)  acts  on 
the  set  point  to  produce  the  intermediate  signal  w{z}=T(z}r(z),  which  has  the  simple  time- 
domain  representation 


N  y       N  -1  y  1 

w(t)  =  t  yr(t+N)  +  ty  r(t+N -1)  +  ...  +  t  r(t+l) 
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(2.2.11) 


It  is  useful  to  remark  that  the  nominal  model  (2.2.1)  and  the  functional  (2.2.4)  are  simpler 
versions  of  more  elaborate  formulations  that  improve  the  design  performance  at  the  expense 
of  added  complexity. 
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Figure  2-1.  (a)  Structure  of  a  nominal  predictive  controller,  (b)  Structure 
of  the  parametrized  predictive  controller  featuring  the  Youla  parameter  Q{z). 

Typical  enhancements  are  the  inclusion  of  a  lower  prediction-horizon  parameter 
(Clarke,  et  al,  1987),  the  inclusion  of  a  weighted  end-point  term  in  (2.2.4)  to  guarantee 
stability  for  arbitrary  parameter  choices  (Kwon  and  Byun,  1989;  Demircioglu  and  Clarke, 
1993),  and  the  use  of  an  auxiliary  (filtered)  set  point.  Another  common  practice  is  the 
addition  of  an  exogenous  stochastic  input  to  (2.2.1);  however,  the  inclusion  of  residual 
stochastic  dynamics  in  the  model  is  of  less  significance  in  the  context  of  robust  control 
design  because  such  dynamics  may  conceivably  be  encompassed  within  the  uncertainty 
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model.  These  and  other  typical  design  choices  can  be  accommodated  within  the  framework 
proposed  in  this  chapter  through  obvious  modifications. 

Figure  2- la  illustrates  the  closed-loop  system  established  when  the  nominal  predictive 
controller  (2.2.5)  is  connected  to  the  process  (2.2.1).  In  addition  to  the  set  point  signal 
r(t),  the  figure  also  shows  an  additive  output-disturbance  signal  d(t).  Note  that  the  servo 
dynamics  of  the  closed  loop  are  fully  characterized  by  the  equations 

[A(z)R(z)  +  B(z)S(z)]  y{z)  =  z"B(z)T(z)  r{z)  (2.2. 12) 

[A(z)R(z)  +  B(z)S(z)]  u{z)  =  z"  A(z)T(z)  r(z)  (2.2.13) 
Therefore,  the  stability  of  the  closed  loop  for  a  given  nominal  predictive  controller  can  be 
easily  established  by  calculating  the  roots  of  the  characteristic  polynomial  A(z)R(z)  + 
B(z)S(z).  Furthermore,  due  to  the  presence  of  the  integral  action  (2.2.9)  in  the  controller 
and  to  the  gain  equality  (2.2.10),  the  closed-loop  dynamics  described  by  (2.2.12)  are 
guaranteed  to  realize  zero-offset  in  the  servo  response.  The  integrator  also  guarantees 
perfect  steady-state  disturbance  rejection  for  all  disturbance  signals  that  reach  a  constant 
steady-state.  These  desirable  performance  characteristics  of  the  nominal  controller  will  be 
preserved  in  the  robustified  predictive  controller  designed  in  the  following  sections. 

2.3     Controller  Parameterization 

In  this  section,  the  nominal  predictive  controller  (2.2.5)  is  parametrized  in  terms  of  a 
transfer  function  Q(z)  selected  in  the  spirit  of  Wiener-Hopf  design  (Youla,  et  ai,  1976). 
However,  a  modification  in  the  parametrization  is  introduced  to  achieve  two  important 
design  requirements:  (i)  the  parametrized  controller  must  preserve  the  servo  performance 
and  the  steady-state  disturbance  rejection  properties  of  the  nominal  controller,  and  (ii)  the 
parametrized  controller  must  also  be  a  predictive  controller. 
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Consider  a  nominal  predictive  controller  (2.2.5)  that  stabilizes  the  closed  loop  system 
(2.2.12)  -  (2.2.13).  Because  of  the  stability  condition,  the  nominal  closed-loop 
characteristic  polynomial 

A*(z)  =  A(z)R(z)  +  B(z)S(z) 

(2.3.1) 

of  degree  2n  is  Schur.  In  order  to  parametrize  the  controller,  consider  a  coprime  fractional 
representation  of  the  nominal  plant  model  (2.2. 1)  of  the  form 

/-j^Bfzj^Mzj 

"  A(zj  M(z)  (2.3.2) 
where  A^fzj  and  M(zj  are  proper  and  stable  transfer  functions  that  satisfy  the  Diophantine 
equation 

N(z)X(z)+M(z)Y(z)  =  l 

(2.3.3) 

for  some  pair  of  stable  and  proper  transfer  functions  X(z)  and  Y(z).  (Note  the  use  of 
italicized  capital  letters  for  transfer  functions,  while  polynomials  are  designated  with  plain 
capital  letters.)  A  suitable  (M(z),  N(z))  pair  can  be  readily  derived  from  the  nominal 
characteristic  polynomial  (2.3.1).  The  procedure  consists  of  first  factoring  the  closed-loop 
characteristic  polynomial  into  the  form  A*(z)  =  Ai(z)A2(z),  where  both  Ai(z)  and  A2(z)  are 
of  degree  n.  If  A*(z)  contains  complex  poles  then  Ai(z)  and  A2(z)  are  constructed  such 
that  each  complex-conjugate  pair  is  contained  in  either  Ai(z)  or  A2(z)to  ensure  that  each 
polynomial  factor  has  only  real  coefficients.  Dividing  both  sides  of  (2.3.1)  by  the  factored 
characteristic  polynomial  to  obtain 

A(z)R(z)  ^  B(z)S(z) 


A,(z)A2(z)    A,(z)A2(z)  (2.3.4) 
Finally,  stable  and  proper  factorizations  that  satisfy  (2.3.3)  are  easily  obtained  by  defining 

M(z):=^    N(z):=^  (2.3.5) 
A,fz)  A,(z) 

and 
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Xfzj:=-^     Y(z):=^^  (2.3.6) 
A,(z)  ,  A^d) 

where  X(z)  and  Y(z)  are  clearly  stable  and  proper  rational  transfer  functions.  This  result 
allows  writing  the  nominal  predictive  control  law  (2.2.5)  in  the  equivalent  form 

Yiz)  u(z)  =  Z(z)  r(z)-Xiz)y(z) 

(2.3.7) 

where 

Z(z):=-4-T(z) 

^2(z)  (2.3.8) 

The  set  of  all  solutions  of  (2.3.3)  can  be  written  in  terms  of  the  transfer  functions 

(2.3.5)  -  (2.3.6)  and  a  proper  and  stable  transfer-function  Q(z)  through  the  well-known 

relations  (Youla,  etai,  1976) 

X'{z)  =  X{z)  +  M{z)Q(z) 

(2.3.9) 

nz)  =  Yiz)-N{z)Q{z) 

(2.3.10) 

Therefore,  the  set  of  all  stabilizing  controllers  with  the  structure  (2.3.7)  is  parametrized  in 
the  form 

[Yiz)  -  N{z)Q(z)]  u{z)  =  Ziz)  r(z)-  [X{z)  +  M{z)Q{z) ]y{z)  ^23.  U) 

to  yield  the  control  structure  shown  in  Figure  2- lb.  Clearly,  setting  Q{z)=Q  reduces  the 
parametrized  predictive  controller  (2.3. 1 1)  to  the  nominal  predictive  controller  (2.3.7). 

Note  that  in  contrast  to  the  standard  Youla  parametrization  approach,  the  transfer 
function  X{z)  +  M{z)Q(,z)  appears  in  the  feedback  path  of  Figure  2- lb,  instead  of  appearing 
in  the  control  block  immediately  preceding  the  plant.  This  deliberate  departure  from  the 
standard  approach,  in  conjunction  with  factorizations  (2.3.5)  and  (2.3.6)  that  make  use  of 
the  nominal  closed-loop  polynomial,  introduces  highly  desirable  properties  in  the 
parametrized  input-output  maps  as  explained  in  the  following. 
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Proposition  3.1.  The  nominal  control  loop  of  Figure  2- la  and  the  parametrized 
control  loop  of  Figure  2- lb  have  identical  servo  transfer  functions  y{z)lr{z)  and  u{z)lr{z). 

Proof.  The  proposition  is  proved  trivially  by  carrying  out  block-diagram  algebra  on 
each  figure  to  derive  in  both  cases  the  servo  transfer  functions  y{z)lr{z)  and  u{z)/r{z)  that 
are  immediately  obtained  after  a  rearrangement  of  factors  in  equations  (2.2.12)  and 
(2.2.13).  ♦ 

Corollary  3.1.  Given  that  the  nominal  controller  (2.2.5)  is  a  predictive  controller, 
then  the  parametrized  controller  (2.3.1 1)  is  also  a  predictive  controller. 

Proof.  If  (2.2.5)  is  a  predictive  controller,  then  by  definition  it  yields  a  control 
sequence  {u(t)}  that  minimizes  the  predictive  performance  index  (2.2.4)  for  any  prescribed 
set-point  trajectory  {r(t)}.  From  Proposition  3.1  it  follows  that,  for  the  given  set  point 
trajectory,  the  parametrized  controller  (2.3.1 1)  will  also  produce  the  same  control  sequence 
due  to  the  equality  of  the  servo  transfer  function  u(z)/r(z).  It  follows  then  that  the 
parametrized  controller  is  also  a  predictive  controller  because  it  yields  a  control  sequence 
that  minimizes  (2.2.4).  ♦ 

Since  any  allowable  parameter  Q(z)  yields  the  same  servo  transfer  functions  y(z)/r(z) 
and  u(z)/r(z),  the  parametrized  controller  has  the  intrinsic  capability  of  preserving  the 
nominal  servo  performance.  Also  note  that  although  the  terms  containing  Q( z)  effectively 
cancel  out  in  the  servo  transfer  functions,  the  transfer  function  e(z)/wi(z)  =  M(z)[Y(z)  - 
^(z)Q(z)]  in  Figure  2- lb  is  affme  in  Q(z),  as  in  the  standard  Youla  parametrization  method. 
This  allows  a  shaping  of  the  loop  sensitivity  while  simultaneously  retaining  nominal 
performance. 

2.4     Robust  Predictive  Design 


When  the  nominal  model  (2.2.1)  is  not  exact  due  to  the  presence  of  modeling  errors, 
the  plant  transfer  function  g(z)  may  be  written  in  the  form 
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g{z)=gM+^(z)  (2.4.1) 

where  gofzj  =  is  the  nominal  plant  model,  and-d(z)  is  an  unstructured  perturbation. 

A(z) 

Without  loss  of  generality,  the  developments  are  specialized  for  the  case  of  additive 
perturbations  satisfying 

U(^'")|<|W(g'")|  Vo) 

(2.4.2) 

where  the  uncertainty  weight  W(z)  is  a  stable  and  proper  transfer  function,  and  the 
perturbation  A(z)  is  assumed  to  be  such  that  g(z)  and  go(z)  have  the  same  number  of 
unstable  poles.  The  case  of  multiplicative  perturbations,  as  well  as  other  typical 
unstructured  uncertainty  representations  (Francis,  1987)  can  be  treated  in  an  analogous 
way.  Of  particular  relevance  to  chemical  processing  systems  can  be  the  inverse 
multiplicative  model  (Maciejowski,  1989),  which  allows  for  g(z)  and  go(z)  to  have 
different  number  of  unstable  poles  even  when  the  perturbation  A(z)  is  stable.  The  situation 
where  the  nominal  model  and  the  uncertain  process  have  different  number  of  unstable  poles 
may  arise  in  processing  systems,  for  example,  when  the  process  evolves  through  a 
metastable  steady-state  in  a  CSTR  with  multiple  steady  states. 

The  objective  in  this  chapter  is  to  design  a  robust  predictive  controller  that  stabilizes  the 
closed  loop  for  all  the  members  of  the  uncertain  family  of  plants  (2.4. 1)  -  (2.4.2),  and  that 
in  the  nominal  case  (where  A(z)=0)  it  recovers  the  performance  of  a  nominal  predictive 
controller  (2.2.5)  which  is  designed  solely  on  the  basis  of  the  nominal  model  gjz)-  The 
stability  robustness  of  the  closed  loop  shown  in  Figure  2-2,  which  includes  the 
parametrized  controller  (2.3.1 1)  and  the  uncertain  family  of  plants  (2.4.1)  -  (2.4.2),  can  be 
analyzed  using  H^^  theory  concepts  as  shown  in  Theorem  4. 1  below. 

Theorem  4.1.  A  necessary  and  sufficient  condition  for  the  robust  stability  of  the 
closed-loop  system  of  Figure  2-2  is  the  inequality  condition 

\W(z)C(z)S,(z)\\^<\  (2.4.3) 
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where 


C(z):= 


X(z)  +  M(z)Q(z) 
Y(z)-N(z)Q(z) 


and 


j;(z):=  M(z)[Y(z)-N(z)Q(z)] 


(2.4.4) 


(2.4.5) 


Proof.  Since  the  operators  located  between  signals  r(z)  and  W](z)  are  stable,  it 
suffices  to  determine  robust  stability  conditions  for  the  loop  obtained  by  ignoring  the 
prefilter  operator  z^T(z)/A2(z)  and  thus  considering  w^(z)  as  a  bounded  set-point  sequence. 
The  proof  is  then  completed  by  applying  the  Small-Gain  Theorem  (Maciejowski,  1989; 
Doyle,  et  al,  1992)  to  the  loop  in  question,  according  to  the  following  procedure.  First, 
write  A(z)  :=  A'{z)W{z),  where  A'(z)  is  a  stable  transfer  function  satisfying  ||zi'(z)|L  ^  1» 

and  define  the  '-perturbation  input  variable  q(z)  :=  W{z)u(z)  and  output  variable  p(z)  := 
A'(z)qiz).  Clearly,  the  Zi '-perturbation  variables  are  related  through  the  expression  q(z)  = 
-W(z)C(z)Si(z)p(z),  where  operator  C(z)  and  the  loop  sensitivity  function  are  as 
defined  in  (2.4.4)  and  (2.4.5),  respectively.  Finally,  the  necessary  and  sufficient  robust 
stability  condition  (2.4.3)  follows  readily  by  applying  the  Small-Gain  Theorem  to  the 
transfer  function  -W(z)C(z)Si(z).  ♦ 

d 


1 

u 

Y-NQ 

Figure  2-2.  Structure  of  a  robust  predictive  controller  for  a  plant  with  an 
additive  uncertainty.  An  exogenous  disturbance  d{t)  affects  the  plant 
output. 
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2.4.1  Robust  Synthesis 

We  propose  a  systematic  procedure  for  solving  the  robust  synthesis  problem  without 
resorting  to  approximations  for  the  Youla  parameter.  A  particular  challenge  to  the  design 
problem  posed  is  the  objective  of  including  an  integrator  in  the  robustified  controller  in 
order  to  guarantee  effective  disturbance  rejection.  In  the  first  subsection,  we  develop  a 
design  technique  for  the  base  case  where  the  plant  is  unstable  and  has  no  poles  on  the  unit 
circle.  The  next  subsection  treats  the  case  where  the  plant  is  unstable  but  has  poles  on  the 
unit  circle,  as  in  the  case  of  an  integrator.  The  third  and  fmal  subsection  treats  the  stable 
plant  case. 

2.4.1.1  Unstable  plant  with  no  poles  on  the  unit  circle 

Consider  the  robust  predictive  controller  design  problem  for  the  case  where  the 
nominal  plant  model  gjz)  is  unstable  but  has  no  poles  on  the  unit  circle.  The  synthesis 
problem  is  attacked  by  rewriting  the  robust  stability  condition  (2.4.3)  in  the  equivalent 
model-matching  form 

\\T,(z)-T,(z)Q(z)\l<l  (2.4.6) 

where 

T,(z)=W(z)X(z)M(z)  (2.4.7) 

T2iz)  =  -Wiz)M{zf  (2.4.8) 
Inequality  (2.4.6),  which  is  affine  in  the  unknown  Youla  parameter  Q(z),  is  obtained  by 
substituting  equations  (2.4.4)  and  (2.4.5)  into  inequality  (2.4.3).  The  model-matching 
problem  is  commonly  approached  in  the  context  of  H»  control  theory  using  the  g-iteration 
process  (Glover,  1984),  where  (2.4.6)  is  substituted  by  the  alternative  inequality 

\\TJz)-T,(z)Q(z)l<r 

(2.4.9) 


25 

where  g  is  a  positive  scalar  parameter  selected  by  the  designer.  A  robust  design  is  obtained 
if  a  Youla  parameter  Q(z)  is  found  for  a  specified  g  <  1.  The  key  is  then  to  be  able  to 
synthesize  a  Youla  parameter  with  a  reliable  algorithm. 

One  possible  venue  for  synthesizing  parameter  Qiz)  is  to  map  the  operators  in  (2.4.6) 
into  the  Laplace  domain  using  the  bilinear  transformation,  and  then  use  techniques 
appropriate  for  synthesis  for  continuous  time  systems  (Glover,  1984).  While  this 
procedure  is  sometimes  useful,  it  suffers  from  a  number  of  disadvantages.  In  particular, 
the  resulting  continuous-time  problem  may  be  ill  conditioned,  posing  serious  numerical 
difficulties.  In  addition,  discrete  poles  located  at  zero  (such  as  those  caused  by  pure 
delays)  must  be  excluded  in  order  to  solve  the  problem  in  continuous  time,  because 
otherwise,  the  Glover  procedure  cannot  guarantee  a  state-space  solution  (Rotstein  and 
Sideris,  1992).  In  order  to  avoid  the  complications  and  subtleties  associated  with  the 
bilinear  mapping,  we  advocate  the  use  of  a  z-domain  technique  proposed  by  Rotstein  and 
Sideris  for  solving  the  model-matching  problem  (Rotstein  and  Sideris,  1992;  Rotstein, 
1993).  Their  algorithm  solves  the  problem  of  approximating  a  stable  transfer  function  R{z) 
with  an  antistable  (all  poles  outside  the  unit  circle)  transfer  function  where  the  tilde 

superscript  denotes  the  conjugate  operation  Q~^{z)  :=  0^(1/1).  The  problem,  also  known  as 
the  Nehari  extension  problem  (Maciejowski,  1989),  calls  for  finding  an  antistable  function 
Q^iz)  such  that 

\\Riz)-Q;(z)\\  <r  (2.4.10) 

Section  2.6. 1  gives  relevant  details  of  the  Rotstein-Sideris  algorithm  which  yields  the  set  of 
all  the  solutions  to  (2.4.10).  The  only  inputs  required  are  the  transfer  function  R(z)  and  the 
scalar  y.  A  necessary  condition  for  the  existence  of  a  solution  is  that  y  must  be  greater  than 
the  Hankel  norm  of  R(z),  that  is,  7  >  ||  /Jfzj  ||^ .  One  solution  of  particular  significance  is  the 

central  controller,  denoted  Q^Jiz),  because  the  set  of  all  the  solutions  can  then  be  found  as 
an  exphcit  function  of  Jiz). 
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The  model-matching  problem  (2.4.9)  can  be  written  in  the  form  (2.4.10)  through  a 
series  of  norm-preserving  transformations  as  detailed  in  Section  2.6.1.  The  procedure 
consists  of  first  factoring  Tid)  into  the  form 

(2.4.11) 

where  T^,p{z)  is  an  all-pass  function  and  7^„p(z)  is  a  stable  minimum-phase  function,  and 
then  finding  T,  (z)  =  T  (l/z)  and  carrying  out  the  decomposition 

up 

r  iz)T,{z)  =  R„{z)  +  Rsiz) 

(2.4.12) 

where  R^z)  and  R^{z)  are  an  antistable  and  a  stable  transfer  funcfion,  respectively.  As 
shown  in  Section  2.6.1,  the  transfer-function  required  for  the  Nehari  problem  (2.4.10)  is 

Riz)  =  RM) 

(2.4.13) 

The  central  solufion  Qf^Jz)  is  obtained  from  an  explicit  formula  (see  equation  (2.6.4) 
in  SecUon  2.6.1),  and  a  solution  to  the  original  model-matching  problem  (2.4.6)  is  simply 
recovered  as 

Q(z)  =  T„,;\zm{z)  +  Q,,{z)) 

(2.4.14) 

The  final  robust  predictive  controller  design  for  the  base  case  is  obtained  by 
substituting  in  the  structure  (2.3.11),  the  Youla  parameter  (2.4.14),  and  the  factorizations 
(2.3.5)  -  (2.3.6). 

2.4.1.2  Unstable  plant  with  poles  on  the  unit  circle 

When  the  nominal  plant  model  g^iz)  has  poles  on  the  unit  circle,  the  standard 

control  theory  is  no  longer  applicable.  In  addition,  the  factorization  (2.4.11)  is  no  longer 
feasible  because  no  minimum-phase  stable  transfer  function  can  possibly  satisfy  the 
equality.  This  difficulty  is  circumvented  by  introducing  a  change  of  variable  that  maps 
unit-circle  poles  to  a  circle  of  larger  radius.  Let  z  =  ^p,  where  p  >1  is  a  scalar,  and  define 
the  operators 
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T{{0=m/p)  (2.4.15) 

and 

T^{1;)=%{Up)  (2.4.16) 
Note  that  the  mapping  z  =  C/p>  is  a  special  case  of  the  well  known  bilinear  transformation. 
The  effect  of  the  transformation  is  to  map  all  the  z-plane  poles  located  on  the  unit  circle  into 
^-plane  poles  located  on  a  circle  of  radius  p  .  Using  equations  (2.4.15)  -  (2.4.16),  the 
base-case  design  problem  (2.4.9)  can  be  posed  in  terms  of  the  transformed  variable  ^  to 
yield 

||7;'(0-r,'(0^(C)|L<7  ^^-"^-^^^ 

Problem  (2.4.17)  and  can  be  solved  for  Q'(Q  using  the  base-case  algorithm  described  in 
Section  4.1.1.  The  z-domain  Youla  parameter  is  simply  recovered  by  transforming  the 
result  back  to  the  original  space,  that  is, 

(2.4.18) 

Q(z)  =  Q'(pz) 

and  the  final  robust  predictive  controller  design  for  this  case  is  obtained  by  substituting  in 
the  structure  (2.3.11),  the  Youla  parameter  (2.4.18),  and  the  factorizations  (2.3.5)  - 
(2.3.6). 

Using  the  Maximum  Modulus  Theorem,  it  follows  that  the  transformed  design 
problem  (2.4.17)  is  related  to  the  original  problem  (2.4.6)  through  the  inequality 

II  T:  (0- (C)<^  (OIL  ^  II  T,{z)- T,{z)Q{z)\l  (2.4.19) 
Therefore,  the  transformed  design  represents  only  a  sufficient  condidon  for  stability.  If  no 
Q'iQ  can  be  found  that  satisfies  (2.4.17),  then  a  smaller  value  for  p  is  adopted  and  the 
design  is  repeated. 

2.4.1.3  Robust  design  for  the  case  of  a  stable  plant 

When  the  nominal  plant  model  gQ(z)is>  stable,  the  robust  design  is  straightforward.  In 

the  normal  case  where  the  weight  W{z)  is  minimum  phase  {i.e.,  it  does  not  have  zeros  on 
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or  outside  the  unit  circle),  a  solution  to  the  robust  synthesis  problem  (2.4.6)  is  obtained  by 
setting  T^(z)-TJz)Q(z)  =  TJz),  where  T^(z)  is  a  user-specified  stable  biproper  transfer 
function  that  satisfies  the  contraction  condition  l^jf^jjl^  <  1.  Solving  for  the  unknown 
parameter  as  a  fianction  of  T^{z)  yields  the  design  equation 

Q(z)  =  T2-\z){T^iz)-T,{z))  (2.4.20) 
where  Q(z)  is  clearly  a  stable  transfer  function  because  T2(z)  is  minimum  phase.  In  the 
alternative  case  where  the  weight  W(z)  is  nonminimum  phase,  the  design  equation  used  is 

Q(z)  =  T;'(z)(T,(z)-W(z)T,(z))  (2.4.21) 
which  is  obtained  by  setting  T^(z)  -  T2(z)Q(z)  =  W(z)T^(z),  where  T^^U)  is  a  user- 
specified  stable  biproper  transfer  function  satisfying  ||V^('z>)7'3('z)|L<l-   The  final  robust 

predictive  controller  design  results  by  substituting  in  the  structure  (2.3.11)  the  Youla 
parameter  (2.4.20)  or  (2.4.21),  along  with  the  factorizations  (2.3.5)  -  (2.3.6). 

2.4.2  Robust  Design  with  Steady-State  Disturbance  Rejection 

In  process  control  applications,  the  controller  is  often  required  to  deliver  effective 
disturbance-rejection  performance.  This  section  presents  a  method  for  introducing  integral 
action  in  the  robustified  controllers,  hence  ensuring  offset-free  regulation  in  the  presence  of 
asymptotically  constant  disturbances.  Given  that  the  nominal  predictive  controller  (2.2.5) 
leads  to  the  nominal  regulation  transfer  function 

y(z)  ^  A(z)R(z) 

d(z)  A(z)R(z)  +  B(z)S(z)  (2.4.22) 
it  follows  that  lim>'(0  =  0  for  step  disturbances  as  well  as  for  other  disturbances  with  a 

constant  steady  state  because  R(l)  =  0.  On  the  other  hand,  from  Figure  2-2  it  follows  that 
the  nominal  regulation  transfer  function  for  the  robustified  predictive  controller  (2.3.12)  is 

y(z)^        A(z)R(z)  A(z)B(z) 

d(z)    A(z)R(z)  +  B(z)S(z)      Af(z)      ^  (2.4.23) 
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Because  the  synthesis  procedures  described  in  the  previous  section  do  not  necessarily  yield 
a  Youla  parameter  satisfying  Q(l)  =  0,  the  robustified  predictive  controller  may  display 
unacceptable  nominal  regulation  performance  at  the  steady  state,  unless  the  nominal  plant 
has  an  integrator  (that  is,  A(1)=0)  or  is  a  self-regulating  process  (B(l)  =  0).  The  robust 
predictive  control  design  for  integrating  plants  is  carried  out  as  indicated  in  Section  4. 1 .2, 
and  the  design  for  self-regulating  plants  is  treated  as  in  Sections  4.1.1,  4.1.2,  or  4.1.3, 
depending  on  the  location  of  the  poles. 

Clearly,  the  robust  predictive  controller  will  attain  perfect  steady-state  disturbance 
rejection  for  all  the  plants  belonging  to  the  uncertain  family  (2.4.1)  only  if  the  Youla 
parameter  has  a  zero  gain,  that  is,  Q(l)  =  0.  This  gain  constraint  can  be  introduced  in  the 
robust  predictive  controller  design  through  a  simple  modification  of  the  factorizations 
(2.3.5)  -  (2.3.6).  First,  the  integrator  is  extracted  from  the  nominal  predictive  controller  by 
writing  R(z)  =  {z-\)R'(z),  and  then  (2.3.4)  is  rewritten  in  the  form 

Aiz)(z-m\z)  ,  B(z)Siz) 


A,{z)A,iz)  \iz)A,{z) 
Introducing  the  modified  coprime  factorization 


=  1  (2.4.24) 


and 


M(,),=  (lzl)Mll    iV(z):=^  (2.4.25) 
zA^(z)  A(z) 


i(e):=^  Y(z):=^  (2.4.26) 

A2(z)  A^iz) 


leads  to  operators  that  satisfy  the  Diophantine  equation  N(z)X(z)+M(z)Y(z)=L  The 
modified  form  of  inequality  (2.4.9)  can  then  be  written  as 

\f,(z)-f,iz)Q(z)\l<r  (2.4.27) 

with 

f,(z)=W(z)X(z)M(z)  (2.4.28) 

t{z)  =  -W{z)Mizf  (2.4.29) 
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Note  that  the  definition  of  M(z)  in  (2.4.25)  is  equivalent  to  designing  a  controller  for 
a  nominal  plant  which  has  been  augmented  by  an  integrator.  It  is  now  possible  to  proceed 
to  solve  (2.4.27)  for  a  parameter  Q(z)  using  the  base-case  algorithm,  as  described  in 
Section  4.1.2.  After  a  solution  to  (2.4.27)  is  found,  the  Youla  parameter  Q(z)  used  in  the 
parametrized  predictive  control  structure  of  Figure  2-2  is  constructed  by  re-associating  the 
augmented-plant  integrator  with  the  controller  to  obtain 

Q(z)=^.^Q(z)  (2.4.30) 
z 

The  final  robust  predictive  controller  design  for  this  case  is  obtained  by  substituting  in  the 
structure  (2.3.11),  the  Youla  parameter  (2.4.30),  and  the  factorizations  (2.3.5)  -  (2.3.6). 
The  resulting  controller  includes  an  integrator  since  (2.4.30)  satisfies  the  zero-gain 
condition  Q(i)  =  0. 

Finally,  it  is  useful  to  note  that  when  the  nominal  model  gjz)  is  stable,  it  may  be 
possible  to  include  integral  action  in  the  robust  predictive  controller  through  simple 
specifications.  In  particular,  this  is  readily  accomplished  by  adding  to  the  design  equation 

(2.4.20)  the  gain-equality  specification  13(1)  =  r,f  1)  if  the  uncertainty  weight  W(z)  is 
minimum  phase,  or  adding  the  gain-equality  constraint  13(1)  =  Ti(l)/W(\)  to  equation 

(2.4.21)  if  the  weight  is  nonminimum  phase.  These  specifications  lead  to  the  desired 
offset-free  condition  Q(l)  =  0.  However,  if  Tjf  1)  >  1,  these  simple  designs  are  infeasible 
because  T^tz)  cannot  simultaneously  satisfy  the  contraction-mapping  and  the  gain-equality 
conditions.  In  such  a  case,  the  robust  design  with  integral  action  must  be  done  following 
the  general  procedure  (2.4.25)  -  (2.4.30). 

2.5  Example 

This  section  illustrates  the  use  of  the  robust  design  technique  via  an  example.  Note 
that  the  robust  synthesis  technique  proposed  here  is  applicable  to  both  stable  and  unstable 
processes.    In  contrast,  most  of  the  alternative  robust  predictive  control  strategies 
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documented  in  the  literature  are  simply  not  applicable  to  unstable  plants.  In  order  to 
maximize  the  impact  of  the  example,  we  adopt  an  unstable  nominal  plant  for  the  illustration. 
Even  though  open-loop  unstable  chemical  processes  are  not  predominant  in  the  chemical 
industry,  there  is  nevertheless  a  number  of  such  processes  that  are  of  economic  importance 
(Muske  and  Rawlings,  1993b).  In  particular,  the  unstable  batch  chemical  reactor  studied 
by  Rotstein  and  Lewin  (1992)  is  characterized  by  a  plant  model  with  one  unstable  pole. 
The  wire-catalyzed  combustion  reactors  investigated  by  Sheintuch  (1989)  and  the  network 
of  cascaded  exothermic  CSTRs  analyzed  by  Georgiou,  et  al.  (1989)  include  plant  models 
with  more  unstable  poles.  Consider  the  second-order  nominal  plant  model 

g^z)  =  -^d^   (2.5.1) 

"       Z--0.6Z  +  1.12 

which  has  two  complex-conjugate  poles  that  lie  outside  of  the  unit  circle.  The  nominal 
plant  is  subject  to  an  additive  uncertainty  perturbation  characterized  by  the  weight 

0.63Z  +  0.6174  ^2.5.2) 
z  +  0.5 

which  reflects  the  extent  of  the  model  uncertainty  measured  in  the  frequency  domain. 
Although  the  specification  of  appropriate  uncertainty  weights  is  a  subject  of  current 
research,  insight  into  practical  procedures  for  its  determination  is  given  in  a  number  of 
recent  publications  (see  for  example  Latchman  and  Crisalle,  1995;  Doyle,  et  al,  1992; 
Koung  and  MacGregor,  1993). 

Three  controllers  are  designed:  (/)  a  nominal  predictive  controller  (NPC),  (//)  a  robust 
predictive  controller  (RPC),  and  (///)  a  robust  predictive  controller  with  integral  action 
(RPCI).  The  nominal  predictive  controller  is  of  form  (2.2.5),  and  is  realized  using  the 
design  parameters  Ny  =  A,N^^  =  2,^ndX=  0,  and  the  design  equations  given  in  Section 
2.6.2,  to  arrive  at  the  polynomials 

R(2)  =  22_o.8039z-O.I96I 
S(z)  =  0.8639z^  -  1.579Z -H.0984 
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T(z)  =  0.29 14z^  -  0.0156z^  +  0.366z^  +  0.3243z 
which  lead  to  a  nominal  predictive  controller  that  stabilizes  the  closed  loop  when  the 

uncertainty  is  neglected.  However,  the  NPC  controller  is  not  robustly  stabilizing  because  it 
violates  the  robust  stability  condition  (2.4.3),  that  is  ||  Wiz)C{z)Jl{z)\\^  =  2.9  >  1,  where 

C(z)  and  Si(z)  are  calculated  using  Q(z)  =  0  in  (2.4.4)  and  (2.4.5).  This  implies  that  the 

nominal  predictive  controller  will  fail  to  stabilize  the  closed  loop  for  some  plants  belonging 

to  the  family  of  uncertain  plants.  Efforts  to  detune  the  nominal  controller  by  extending  the 

prediction  horizon  up  to  the  value  Ny  =  30,  as  well  as  increasing  the  control  horizon  to 

values  greater  than  the  number  of  unstable  poles,  also  fail  to  yield  robustly  stabilizing 

controllers.  Clearly,  the  lack  of  success  of  the  detuned  controllers  in  robustly  stabilizing 

the  feedback  loop  is  due  to  the  fact  that  the  detuning  procedure  is  conceived  without  taking 

into  account  the  explicit  additive  uncertainty  model  available  through  the  description 

(2.5.2). 

The  RPC  design  is  of  the  form  (2.3.11).  Since  the  unstable  nominal  plant  has  no 
poles  on  the  unit  circle,  the  design  proceeds  as  discussed  in  the  base  case  (Section  4.1.1). 
The  transfer  functions  T^(z)  and  T2(z)  are  formed  as  prescribed  in  (2.4.7)  and  (2.4.8), 
using  Ajiz)  =  Z-.  To  solve  the  Nehari  extension  problem,  we  use  y=  0.99,  which  is 
acceptable  since  it  exceeds  the  limiting  Hankel  norm  value  ||  R{z)  ||^  and  is  less  than  one  as 

required  by  (2.4.6).  The  central  controller  found  using  the  base-case  algorithm  leads  to  a 
Youla  parameter  Q(z)  =  Ngfzj/Dgfzj  of  order  8,  with 

Ng(z)  =  -0.8688z^  +  2.026z'  -  2.6992"  +  1.515z'  +  0.4916z' 
-2.267z^  +  2. 144z^  - 1 .297z  +  0.3668 

Dg(z)  =  z'-  0.6252z'  + 1 .9582"  +  0.4477z'  +  0.  l92Sz' 
+1.809Z-'  -0.5414z'  +0.6926Z 
The  RPC  transfer  functions  Y(z)  -  N(z)Q(z),  and  X(z)  +  M(z)Q(z),  are  of  order  9  in  their 
minimal  forms.  The  controller  is  robustly  stabilizing  because  ||  W^(z)C(z)4'(z)  |L=  0.35<  1. 
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Finally,  the  design  of  the  RPCI  is  carried  out  as  indicated  in  Section  4.2,  using  again 
the  specification  7  =  0.99.  Since  this  controller  design  includes  an  integrator,  the  bilinear 
transformation  z  =  ^/p  discussed  in  Section  4.1.2  is  implemented  using  the  value  p  =  1.1. 
The  procedure  leads  to  a  Youla  parameter  Q(z)  =  (z-1)^q(z)/{zDq(z)  )  of  order  9,  with 

Ng(z)  =  -0.8648z'  +  2.534z'  -  2.766z'  +  0.9587z-'  +  0.669 Iz' 
-1.006z'  +0.6545r  -0.2434Z  + 0.0389 

Dg(z)  =    -  2. 19z'  +  2. 1 8     - 1 . 129z'  -  0.2604z' 
+0.8927Z-'  -  0.7056z'  +  0.3307z  -  0.0734 
The  resulting  RPCI  transfer  functions  Y(z)  -  N(z)Q(z)  and  X(z)  +  M(z)Q(z)  are  of  order  10 
in  their  minimal  forms,  and  Q(l)  =  0,  as  desired.   The  RPCI  controller  is  robustly 
stabilizing  because  ||  W(z)C(z)J)"(z)|L  =  0.49  <  1. 

Figure  2-3  shows  the  results  of  a  closed-loop  simulation  test  carried  out  to  evaluate  the 
nominal  servo  and  regulation  performances  of  the  three  controller  designs.  The  process  is 
assumed  to  match  exactly  with  the  nominal  model,  that  is,  A(z)  =  0.  The  servo  test  features 
step  changes  in  the  set  point  r(t)  at  instants  r  =  0  and  f  =  50,  and  the  regulation  test  is  carried 
out  by  introducing  a  unit-step  disturbance  d(t)  (not  shown  in  the  figure)  at  t  =  12. 

Figure  2-3a  shows  that  during  the  first  12  samples,  where  d(t)  =  0,  all  three  controllers 
display  identical  dynamics.  This  is  the  expected  result  since  Proposition  3.1  guarantees 
that  the  nominal  predictive  controller  and  the  robustified  controllers  have  identical  servo 
transfer  functions,  independent  of  the  value  of  Q(z).  Also  as  expected,  the  controller- 
output  trajectories  shown  in  Figure  2-3b  are  also  identical  during  this  interval. 

The  three  controllers  differ  however  in  their  regulation  behavior.  When  the 
disturbance  is  introduced  at  t  =  12,  the  NPC  rejects  the  disturbance  effectively,  quickly 
returning  the  output  to  the  set  point,  as  shown  in  Figure  2-3a.  In  marked  contrast,  the  RPC 
fails  to  reject  the  effect  of  the  disturbance,  and  displays  steady-state  offset.  The  RPCI, 
however,  succeeds  in  rejecting  the  disturbance,  albeit  with  slower  dynamics  than  the 
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Figure  2-3.  Comparison  of  the  performance  of  the  nominal  predictive 
controller  (NPC),  the  robust  predictive  controller  (RPC),  and  the  robust 
predictive  controller  with  integral  action  (RPCI)  designed  for  a  nominal  plant. 
The  set  point  r(t)  changes  at  instants  t  =  0  and  t  =  50.  A  unit-step  disturbance 
d(t)  (not  shown)  is  introduced  at  r  =  12.  a)  Output  and,  b)  Control  action. 
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nominal  controller.  Figure  2-3b  shows  that  the  NPC  achieves  the  disturbance  rejection  at 
the  expense  of  fairly  energetic  control  actions  that  follow  the  onset  of  the  disturbance. 

On  the  other  hand,  the  RPCI  prescribes  more  conservative  input  adjustments,  typical 
of  robust  controllers.  In  many  practical  situations,  the  smoother  dynamics  of  the  RPCI 
design  may  be  highly  preferable  over  the  more  aggressive  behavior  of  the  NPC. 

As  a  final  remark,  one  should  note  that  all  the  controllers  anticipate  the  occurrence  of 
set-point  change  at  t  =  50,  as  evidenced  by  the  early  adjustments  in  control  action  that  take 
place  starting  at  instant  t  =  46,  as  shown  in  Figure  2-3b.  This  anticipatory  behavior  is  a 
characteristic  of  predictive  controllers.  Since  the  prediction  horizon  A^y  has  been  selected 
equal  to  four  samples,  the  controllers  naturally  initiate  adjustments  at  instant  t  =  46  when 
the  prediction  horizon  first  permits  detection  of  the  upcoming  set-point  change.  This 
observation  verifies  that  the  robustified  control  designs  can  legitimately  be  classified  as 
predictive  controllers,  as  claimed  in  Corollary  3.1. 

Figure  2-4  shows  the  results  of  a  closed-loop  simulation  test  for  a  perturbed  plant 
{A(z)  5^  0).  As  in  the  previous  example,  the  set-point  changes  at  instants  t  =  0  and  t  =  50, 
and  an  external  unit-step  disturbance  d(t)  is  introduced  at  t  =  12.  The  figure  shows  that  the 
NPC  is  unable  to  control  the  plant,  causing  unstable  closed-loop  dynamics.  In  marked 
contrast,  both  robust  predictive  control  designs  RPC  and  RPCI  have  stable  responses.  As 
expected,  the  RPC  controller  suffers  from  steady-state  offset  due  to  the  lack  of  an 
integrator,  whereas  the  RPCI  controller  has  offset-free  behavior  and  manages  to  reject  the 
disturbance  without  excessive  control  action. 

2.6     Model-Matching  Problem  and  Predictor  Design  Equations 

2.6.1  Rotstein-Sideris  Solution  to  the  Model-Matching  Problem 

The  transformation  of  the  model-matching  problem  (2.4.9)  to  the  form  (2.4.10)  can  be 
done  in  a  straightforward  fashion  as  follows.  First,  T2(z)  must  be  factored  as  shown  in 
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(2.4.11).  Then,  using  the  property  that  |  T^^pCzjCfz^l  =||G('zj|L,  it  is  possible  to  write  the 
equalities 


T,(z)-T,(z)Q(z)\i=K(z)T,(z)-TJz)Q(z)\l=\\RJz)  +  RJz)-TJz)Q(z)^^^^^^ 


mp 


Defining  R~(z)  :=  Ra(z)  and  Qj^(z)  :=  Rs(z)  -  Tmp(z)Q(z),  and  using  the  property 
I  G~fzj II  =  llGfzjjL,  the  previous  equality  readily  reduces  to  the  desired  form 


\T,(z)-yz)Q(z)\\=\\R(z)-Q;(z 


(2.6.2) 


Note  that  the  factorization  (2.4.1 1)  is  not  possible  for  nominal  plants  with  poles  on  the 
unit  circle.  Such  special  cases  must  be  treated  as  discussed  in  Section  4. 1 .2.  A  solution  to 
the  model-matching  problem  (2.4.10)  is  proposed  by  Rotstein  and  Sideris  (1992),  and  the 
main  result  is  stated  in  the  theorem  below. 

Theorem  2.6.1.  Let  /?fzj  be  a  stable  and  proper  transfer  function  with  a  minimal  state- 
space  realization 

R(z)  :=  C(zJ-Ar'B  +  D  = 


(A 

and  let  the  scalar  7>||/?fzj||^.  Then  the  set  of  all  antistable  proper  transfer  functions 
Q'iz)  satisfying  ||/?  -     ||  <  7  are  given  by  the  conjugate  of 

Qr(z)  =  F{Q,Jz),0{z))  (2.6.3) 
where  the  operator  F,(»,»)  represents  a  linear-fractional  transformation,  and  Ofzj  is  a 
stable  and  proper  transfer  function  satisfying  H^CzjL  7  ■  Transfer  function  Q^i^  Jz)  is  the 
central  solution  defined  as 


(a-B{B^L^,A  +  EJ,C)N 

(AL^C^  +  BE^,) 

-BDlA 

iEl,C  +  B'L„A)N 

(2.6.4) 

-Dl^CN 

1^22  ) 

where  and  L„  respectively  denote  the  controllability  and  observability  grammians  of 
R{z),  which  are  the  solutions  to  the  discrete-time  Lyapunov  equations 
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Figure  2-4.  Comparison  of  the  performance  of  the  nominal  predictive 
controller  (NPC),  the  robust  predictive  controller  (RPC),  and  the  robust 
predictive  controller  with  integral  action  (RPCI),  designed  for  a  perturbed  plant 
belonging  to  the  uncertainty  description.  The  set  point  r{ t)  changes  at  instants  t  = 
0  and  r  =  50,  and  a  unit-step  disturbance  d(t)  (not  shown)  is  introduced  at  r  =  12. 
a)  Output  and,  b)  Control  action. 
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L  =ALA^  +  BB^ 


(2.6.5) 


L„  =  A^L„A  +  C^C 


(2.6.6) 


and  N  =  (y^I  -  L^.L,J'\  Rotstein  (1992b)  gives  details  on  the  construction  of  auxiliary 
matrices  E^^  and  Dy,  which  depend  on  matrices  A,  B,  C,  D,  and  L,,  and  on  the  value 
of  /. 

The  central  controller  (2.6.4)  can  be  directly  calculated  from  a  solution  to  (2.6.5)  - 
(2.6.6)  and  the  appropriate  definitions  for  matrices  and  D^.  The  use  of  the  Hankel- 
norm  condition  y  >  \\  R(z)\\fj  stems  from  the  fact  that  the  minimum  value  of     -  2^||^over 

the  stable  proper  transfer  functions  Q(z)  is  exactly  equal  to  Hence,  the  only 

legitimate  values  of  /are  those  exceeding  the  Hankel  norm. 

2.6.2  Design  Equations  for  Nominal  Predictive  Control 

This  section  provides  specific  design  equations  used  to  synthesize  a  nominal  predictive 
controller  following  the  approach  of  Crisalle,  et  al.  (1989).  An  equivalent  formulation  is 
given  by  Mcintosh,  et  al.  (1991).  The  final  design  equations  for  the  polynomials  (2.2.6)  - 
(2.2.8)  that  appear  in  the  predictive  control  law  (2.2.5)  are: 


where  the  design  operators  F/z"')  and  F/z"!)  and  the  coefficients  i=l,  2,  N  are 
determined  from  the  process  model  according  the  following  procedure.  First,  rewrite  the 
nominal  plant  model  (2.2.1)  -  (2.2.3)  in  the  equivalent  form 


R(z)  =  z"[l  +  z-'X,1,^,r,(z-') 


(2.6.7) 


(2.6.8) 


(2.6.9) 


A,(z-')>'(z)  =  z-'B,(z-)m(z) 


(2.6.10) 
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involving  inverse  powers  of  z,  where  Ajfz"' j  and  are  related  to  (2.2.2)  and  (2.2.3) 

in  an  obvious  manner  and  are  of  the  form 

A  ,(z"' )  =  1  +         +  a,2Z-^  + ...  +  a,„y'  (2.6. 1 1) 

B,(z-')  =  &,,o+V"'+-  +  ^u.2'"^  (2.6.12) 
To  obtain  the  design  operators  F/z'^),  which  are  polynomials  of  degree  n  (the  order  of  the 
plant  (2.2.1)),  solve  the  set  of  Diophantine  equations 

E,(z-' )A(z-' )  A, (Z-' )  +  Z-'  F, (z"' )  =  1      /  =  1 ,  2,     yv  (2.6. 13) 

which  also  yields  the  intermediate  polynomials  E/z-^j  of  degree  /-I.  The  second  design 
operators,  the  polynomials  r,(z'')  of  degree  n,  are  obtained  by  decomposing  the  product 
E/z-ljEfz-ljintheform 

E,(z-'  )B,  (Z-' )  =  G,(z-' )  +  z-T,  (z"' )  (2.6. 14) 

where  polynomials  G/z'^)  of  degree  i-l  are  known  as  the  dynamic  polynomials,  and  are 
characterized  by  the  fact  that  their  coefficients  are  the  sampled  values  of  the  step-response 

of  the  plant  (2.6.10).  In  turn,  the  coefficients  of  the  dynamic  polynomials  are  used  to 
define  the  nonzero  elements  of  the  Toeplitz  matrix  Gyy^  known  as  the  truncated  dynamic 

matrix,  which  contains  only      columns.  Finally,  the  coefficients  ^,  ,  i=l,  2,      N  are 

obtained  as  the  components  of  the  gain  vector  A:T=[ki  k2  ...  k^],  calculated  from  the 

expression 

;tT=[l   0   ••■   0]{GlG,^+AiyGl  (2.6.15) 
2.7  Conclusions 

A  systematic  method  for  robustifying  unconstrained  predictive  controllers  has  been 
proposed.  The  technique  succeeds  in  preserving  nominal  servo  performance  due  to  the 
unconventional  feedback  configuration  adopted  for  the  parametrized  controller,  and  also 
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due  to  a  coprime  factorization  that  makes  use  of  the  characteristic  polynomial  of  the  nominal 
closed  loop.  A  significant  feature  of  the  proposed  method  is  its  applicability  to  both  stable 
and  unstable  plants.  Another  advantage  of  the  robust  synthesis  technique  is  that  it  permits 
the  incorporation  of  integral  action  in  the  robustified  controllers,  making  the  resulting 
controllers  more  useful  for  practical  applications.  Although  the  technique  is  developed  for 
single-input  single-output  systems,  we  anticipate  that  the  methodology  presented  in  this 
chapter  extends  naturally  to  the  multivariable  case.  A  limitation  of  the  proposed  method  is 
that  it  does  not  take  into  account  the  effect  of  input  saturation.  A  possible  venue  to  address 
this  problem  is  to  restate  the  problem  (2.4.9)  as  a  mixed  I^IH^  problem  that  explicitly 
takes  into  consideration  constraints  on  the  manipulated  variable.  Research  is  currently  in 
progress  addressing  the  robustification  of  constrained  predictive  controllers. 


CHAPTER  3 

ROBUST  PREDICTIVE  CONTROL  WITH  CONSTRAINTS  VIA  UH^ 

DESIGN 

\ 

3.1     Introduction  i 

Predictive  control  has  been  an  active  area  of  research  for  almost  two  decades,  and  has  j 
received  increased  attention  in  recent  years.  Currently,  much  research  emphasis  is  on  the  : 
robustification  of  predictive  controllers  through  design  techniques  that  guarantee  the  I 
stability  and/or  adequate  performance  of  the  closed-loop  system  when  the  plant  model  is 
uncertain.  Although  there  exists  rich  theory  for  the  robust  control  of  linear  systems,  few 
results  are  available  concerning  the  robust  control  of  systems  with  constraints.  Such 
constraints  are  important  in  practical  control  engineering  applications  because  safety, 
economics,  and  performance  specifications  often  impose  bounds  on  key  process  variables. 
The  control  system  must  therefore  anticipate  constraint  violations  and  take  action  to  correct 
them.  Several  results  have  appeared  recently  on  predictive  control  with  constraints  for 
systems  where  the  plant  model  is  assumed  to  be  known  exactly.  Rawlings  and  Muske 
(1993)  showed  that  nominal  stability  can  be  guaranteed  for  the  state  feedback  regulator 
using  an  infinite  horizon,  and  Muske  and  Rawlings  (1993)  address  the  rejection  of  step 
disturbances  and  extend  the  nominally  stabilizing  regulator  to  use  output  feedback.  The 
latter  reference  contains  also  an  extensive  discussion  of  existing  linear  Model  Predictive 
Control  strategies  up  to  1992.  Different  approaches  to  the  constrained  predictive  control 
problem  in  the  absence  of  disturbances  are  reported  by  Sznaier  and  Damborg  (1993), 
Camacho  (1993),  Rossiter  and  Kouvaritakis  (1993),  Scokaert  and  Clarke  (1994),  and 
Gilbert,  et  al.  (1994). 
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The  introduction  of  disturbance  signals  complicates  the  design  problem.  In  the 
absence  of  constraints,  the  inclusion  of  disturbances  does  not  affect  the  loop  stability,  even 
though  the  overall  performance  may  deteriorate.  Disturbances  may  have  a  more  detrimental 
effect  when  constraints  are  present,  possibly  affecting  the  stability  of  the  system  when  the 
open-loop  plant  is  unstable.  Rossiter,  et  al.  (1994)  examine  the  effect  of  disturbances  on 
the  stability  of  the  closed-loop  under  constrained  predictive  control  using  an  exact  plant 
model.  The  difficulties  are  further  compounded  when  robustness  with  respect  to  model- 
uncertainty  is  also  considered,  and  the  results  reported  in  the  literature  are  scarce.  Zafiriou 
(1990)  investigates  the  robustness  of  a  Dynamic  Matrix  Control  scheme  with  hard 
constraints,  using  the  contraction-mapping  principle.  This  approach  leads  to  robust 
stability  conditions  which  implies  an  optimization  problem  with  mathematical  tractability 
problems.  The  remaining  contributions  include  the  work  of  Genceli  and  Nikolaou  ( 1993), 
and  of  Zheng  and  Morari  (1993),  who  have  derived  conditions  for  robust  stability 
assuming  a  linear  performance  functional  (instead  of  the  more  classical  quadratic  functional 
characteristic  of  predictive  control),  and  assuming  an  uncertainty  description  that  places 
bounds  on  the  impulse-response  coefficients. 

This  chapter  addresses  the  problem  of  robust  predictive  control  design  for  optimal 
regulation  in  the  presence  of  input  or  output  process  constraints.  In  many  cases,  there  is 
little  information  available  about  the  nature  of  the  disturbances,  in  a  deterministic  or 
stochastic  sense.  In  this  chapter,  it  is  assumed  that  disturbances  are  persistent,  but 
bounded,  which  makes  good  practical  sense.  This  is  an  extension  to  the  constant 
disturbance  model  commonly  adopted  in  the  Model  Predictive  Control  literature.  The 
proposed  approach  consists  of  parametrizing  a  nominal  predictive  controller  which  is 
designed  using  conventional  and  well  established  methods.  The  nominal  plant  is  assumed 
to  be  affected  by  unstructured  additive  uncertainty,  which  may  represent  unmodeled 
dynamics.  Other  uncertainty  models  can  be  accommodated  in  an  analogous  fashion. 
Using  recently  developed  extensions  of  robust  linear  control  theory,  the  problem  of  robust 
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stability  in  the  presence  of  constraints  can  be  formulated  as  a  mixed  optimization 
problem  (Sznaier,  1994).  In  this  approach,  an  /j  norm  is  used  to  ensure  satisfaction  of  the 
constraints,  while  robust  stability  is  guaranteed  using  methods.  The  resulting  design 
technique  simultaneously  addresses  the  problem  of  robust  stabilization  under  uncertainty, 
and  the  nominal  performance  of  the  regulator  under  input-saturation  constraints. 

The  chapter  is  organized  as  follows.  Section  2  states  the  elements  of  the  design 
problem,  including  relevant  notation,  and  the  model  and  uncertainty  descriptions  adopted. 
Section  3  formulates  the  constrained  regulation  design  as  a  mixed  ////„  optimization 
problem.  Details  of  the  synthesis  procedure  proposed  are  presented  in  Section  4.  Section 
5  gives  a  design  example  that  illustrates  the  theory,  followed  by  conclusions  in  Section  6. 

3.2     Statement  of  the  Problem 

3.2.1  Notation 

Let  ^  =  {qic}  represent  a  real  sequence.  Then  /cx=  denotes  set  of  bounded  real 
sequences  with  the  norm  |^||^  :=  sup  and  /i  denotes  the  set  of  real  sequences  with 
finite  norm  :=  XI'-ol^'^  I'  ^^^^  represent  a  scalar  complex-valued  transfer  function 
with  real  coefficients.  Then  Loo  denotes  the  Lebesgue  space  of  complex-valued  transfer 
functions  that  are  essentially  bounded  on  the  unit  circle  and  have  the  associated  norm 
||G(zj||^  ••=  sup^^^^^\Giz)\.  Furthermore,  denotes  the  set  of  stable  (that  is,  analytic  in 
Izl  >  1)  transfer  functions  G{z}  e  L^c,  and  HI  denotes  the  set  of  antistable  (that  is, 
analytic  in  Izl  <  1)  transfer  functions  G(z)  e  L^.  Let  Q(z)  denote  the  z-transform  of  a 
sequence  qe  l\,  and  recall  the  fact  that  ^  e  /i  if  and  only  if  Q(z)  e  Hoo.  Finally,  a  tilde 
superscript  is  used  to  indicate  the  conjugate  operation  G(z)~  =  G(  1/z). 
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3.2.2   Uncertainty  Description  and  Process  Constraints 

Consider  the  open-loop  process 

y(z)  =  g(z)u(z)  +  d(z)  (3.2.1) 
where  y(z)  ,  u(z),  and  d(z)  are  the  process  output,  input,  and  disturbance  signals, 
respectively,  and  g(z)  is  a  rational  transfer  function  that  represents  the  plant.  The 
exogenous  signal  d(k)  represents  a  persistent  but  bounded  disturbance  such  that  \\d\\^  <  1, 
where,  without  loss  of  generality,  the  unity  bound  represents  the  result  of  a  signal 
normalization.  The  input  u(k)  is  subject  to  an  operational  constraint  of  the  type  |m||^  <  j3. 
Although  this  paper  explicitly  deals  with  input  constraints,  output  constraints  may  be 
treated  using  an  analogous  procedure. 

The  plant  in  (3.2.1)  is  uncertain  in  the  sense  that  a  nominal  model  go(z)  is  known  such 

that 

g(z)  =  go(z)  +  A(z)  (3.2.2a) 

or 

g{z)  =  go{z)[l  +  Aiz)]  (3.2.2b) 

where  ggiz)  =  is  characterized  by  the  coprime  polynomials 

Hz) 

A{z)  =  z"+a„_,z"-'+...  +  a,  (32.3) 
B{z)  =  b„,z"'+b„,.,z"'-'+...  +  b,  ^32.4) 

and  where  A(z)  represents  the  uncertainty  in  the  nominal  model.  The  model  uncertainty  is 
quantified  through  the  frequency-response  bound 

Aie'^'il  <  Iwie'^^il  \fco  (3_2.4b) 
where  the  known  uncertainty  weight  W(z)  is  a  stable  and  proper  transfer  function. 
Following  the  standard  approach  in  Francis  (1987)  and  Doyle,  et  al.  (1992),  the 
unstructured  perturbation  A(z)  is  assumed  to  be  stable,  so  that  g(z)  and  gd(z)  have  the  same 
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number  of  unstable  poles.  For  simplicity  of  exposition  in  this  paper,  it  is  assumed  that  the 
uncertainty  is  additive.  Multiplicative  unstructured  perturbations  are  also  treated  in  the 
sequel.  Other  uncertainty  types,  such  as  inverse  multiplicative  or  more  complicated  ones, 
can  be  treated  by  the  synthesis  procedure  developed  in  this  chapter  in  a  similar  fashion. 
For  more  details  on  different  uncertainty  descriptions  in  the  frequency  domain,  the  reader  is 
referred  to  Maciejowski  (1989)  and  Doyle,  et  al.  (1992). 

3.2.3  Design  Objectives  and  Proposed  Approach 

The  objective  in  this  chapter  is  to  design  a  predictive  regulator  that  satisfies  two 
specifications.  The  first  specification  is  the  nominal  regulation  performance  of  the 
controller,  requiring  the  effective  rejection  of  the  effect  of  exogenous  disturbances  while 
satisfying  the  input  constraints  in  the  case  when  the  plant  model  is  exact  (that  is,  A(z)  =  0). 
The  second  specification  is  the  robust  stability  of  the  closed  loop,  requiring  the  stabilization 
of  the  system  for  all  the  plants  belonging  to  the  uncertain  family  (3.2.2)  -  (3.2.4b).  Hence, 
the  predictive  controller  design  focuses  on  robust  regulation  under  time-domain  constraints. 

A  mixed  l\/Hco  optimization  approach  is  adopted  to  meet  the  problem  specifications. 
The  nominal  performance  specification  is  addressed  through  an  l\  optimization  problem  that 
seeks  to  minimize  the  effect  of  the  disturbances  on  the  magnitude  of  the  input.  In  addition, 
the  robust  stabilization  specification  is  addressed  in  terms  of  an  Hoo  problem  that  seeks  to 
appropriately  shape  the  loop  frequency-response  in  order  to  guarantee  stability  with  respect 
to  the  modeling  uncertainty. 

The  control  design  procedure  consists  of  first  producing  a  nominal  predictive 
regulator,  designed  ignoring  the  presence  of  modeling  uncertainty  and  exogenous 
disturbances.  Then,  the  nominal  controller  is  rewritten  in  terms  of  a  free  Youla  parameter, 
and  finally,  the  realization  of  a  Youla  parameter  that  meets  both  design  objectives  is 
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obtained  by  solving  an  l\/Hoo  optimization  problem.  The  details  of  the  problem  formulation 
and  its  solution  are  given  in  Sections  3.3  and  3.4,  respectively. 

3.3     Formulation  of  the  Control  Design  Problem 
3.3.1  Controller  Parametrization 

The  cornerstone  of  predictive  control  design  is  the  minimization  of  a  quadratic 
performance  functional 

Jit)  =  X[Kr  +  0  -  yit  +  i\t)f  +  ^J,[Mt  +  /)]  (3.3.1) 

/=1  '=0 

where  {r(t+i)}  is  the  sequence  of  future  set-point  values  (assumed  to  be  known), 
{y(t+i\t)}  is  the  sequence  of  predicted  future  values  of  the  output,  {Au(t+i)}  is  the 
sequence  of  future  control  increments,  A  is  the  move-suppression  parameter,  and 
parameters  A^^  and  are  the  so-called  prediction  and  control  horizons,  respectively.  The 
terms  in  the  first  summation  penalize  future  predicted  errors,  and  the  terms  in  the  second 
summation  penalize  excessive  control  energy.  Of  the  sequence  of  predicted  control 
increments,  only  the  first  is  applied,  and  the  optimization  problem  is  solved  again  in  the 
next  time  instant. 

When  modeling  uncertainties;  process  constraints,  and  the  presence  of  exogenous 
disturbances  are  ignored,  and  the  following  nominal  predictive  control  law  in  feedback 
form  results  as  a  consequence  of  the  minimization  of  the  quadratic  functional  (3.3.1) 
(Crisalle,  etai,  1989) 

^u(z)  =  T(z)r(z)-^y(z)  (3.3.1b) 
z  z 

where  R(z),  S(z),  and  T(z)  are  polynomial  operators.  The  nominal  closed-loop  system 
with  the  RST  configuration  (3.3.1b)  is  shown  in  Figure  3.1,  where  the  plant  is  assumed  to 
be  g(z)  =  go(z)-  For  the  purpose  of  this  chapter,  it  is  useful  to  remark  that  polynomials 
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R(z)  and  S(z)  are  of  degree  n,  that  is,  of  degree  equal  to  that  of  the  nominal  plant 
denominator  polynomial  A(z).  Explicit  formulas  for  the  three  predictive  control 
polynomials  can  be  found  in  Crisalle,  et  al.  (1989)  and  in  Section  2.6.1. 
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Figure  3-1.  Structure  of  a  nominal  predictive  controller. 

Following  the  procedure  discussed  in  the  previous  chapter,  it  is  possible  to  parametrize 
a  stabilizing  nominal  RST  predictive  controller  of  the  form  (3.3.1b)  according  to  Wiener- 
Hopf  theory  (Youla,  et  al.,  1976)  to  yield  a  family  of  nominally  stabilizing  predictive 
controllers.  The  resulting  parametrized  structure  is  shown  in  Figure  3-2,  where  the  Youla 
parameter  Q(z)  is  an  arbitrary  proper  and  stable  transfer  function.  Furthermore,  the  stable 
and  proper  transfer  functions  N(z),  M(z),  X(z),  and  Y(z)  shown  in  Figure  3.2  satisfy  the 
Diophantine  equation  N(z)X(z)+M(z)Y(z)=l,  and  are  functions  of  the  nominal  predictive 
controller  and  the  nominal  plant  through  the  fractional  representations 


,  Afzj  B(z) 
M(z):=—  N(z):= 


and 


AJz)- 


Y(z)  :=  X(z)  := 


S(z) 


(3.3.2) 


(3.3.3) 


A,(z)  '  ""  A,(z) 
where  polynomials  A^(z)  and  A^iz)  have  real  coefficients,  are  both  of  degree  n,  and  are 
obtained  by  factoring  the  characteristic  closed-loop  polynomial  in  the  form 
A(z)R(z)-i-B(z)S(z)  =  A,(z)A2(z).  If  the  characteristic  polynomial  contains  complex 
poles,  then  Ai(z)  and  A2(z)  are  constructed  such  that  each  complex-conjugate  pair  is 
contained  in  either  A\{z)  or  A2(z)  to  ensure  that  each  polynomial  has  only  real  coefficients. 
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Finally,  the  operator  Z(z)  =  z^A2(z)/T(z)  shown  in  Figure  3-2  is  the  set-point  advancement 
transfer  function.  In  Chapter  2,  the  following  theorem  characterizing  the  robust  stability  of 
the  parametrized  control  loop  was  derived. 

'        '  d 
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1 
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Figure  3-2.  Structure  of  a  parameterized  predictive  controller  for  a  plant 
with  a)  additive  uncertainty,  and  b)  multiplicative  uncertainty. 

Theorem  3.1.  A  necessary  and  sufficient  condition  for  the  robust  stability  of  the 
closed-loop  system  of  Figure  3-2  is  the  inequality  condition 

\\W(z)Ciz}^{z)\l<\  (3.3.4) 

where 


C(z):= 


X(z)  +  M(z)Q(z) 
Y(z)-N(z)Q(z) 


(3.3.5) 


and 


^(z)  :=  M(z)  [Y(z)  -  N(z)Q(z)]  (3  3.6) 

Proof.  See  Chapter  2,  and  for  the  standard  approach,  consult  Francis  (1987)  and 
Doyle,  et  al.  (1992).  Also,  in  the  case  of  multiplicative  uncertainty,  the  condition  (3.3.4) 
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should  read  ||  lV(z)!2^(z)|L  <  1,  where  l^iz)  =  1  -  J)(z)  is  the  complementary  sensitivity  of 
the  loop. 

The  dependence  of  the  robust  stability  condition  on  the  parameter  Q(z)  is  made  more 
evident  by  writing  (3.3.5)  in  the  model-matching  form 

\\m-Uz)Q{z)\l<i  (3.3.7) 

where 

T,{z)  =  W{z)Xiz)M{z)  (3.3.8a) 
T,iz)  =  -Wiz)Mizf 
for  the  additive  uncertainty  case  and 

T,iz)=Wiz)Niz)Xiz) 

(3.3.8b) 

T2iz)  =  -W{z)N{z)Miz) 
where  a  multiplicative  uncertainty  description  is  used. 

Hence,  a  robustly  stabilizing  controller  may  be  obtained  by  solving  the  model- 
matching  problem  (3.3.7)  for  Q(z)  e  H^o,  and  then  employing  the  controller  as  shown  in 
Figure  3-2.  This  is  the  approach  taken  in  Chapter  2  to  produce  robust  predictive  control 
designs.  Although  the  resulting  parametrized  controller  is  shown  to  preserve  the  nominal 
servo  (set-point  tracking)  performance  of  the  original  RST  predictive  controller,  it  offers  no 
guarantees  on  the  nominal  regulation  (disturbance  rejection)  performance  of  the  controller 
in  the  presence  of  input  constraints.  This  shortcoming  is  addressed  in  the  following 
subsection  by  combining  the  Hoc  problem  (3.3.7)  with  an  problem  which  takes  into 
account  the  effect  of  the  disturbance  on  the  constrained  variable. 

3.3.2  Nominal  Regulation  and  Robust  Stability  as  an  li/H„  Problem 

In  this  section,  the  problem  of  robust  stabilization  of  a  predictive  control  loop  under 
persistent  disturbances  and  manipulated-variable  constraints  is  formulated  as  an  l\/H^ 
problem.  Although  the  formulation  is  made  for  the  case  of  a  constrained  plant  input,  this 
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choice  fully  illustrates  the  design  procedure,  which  can  be  used  as  a  paradigm  for  the  case 
of  a  similar  constraint  on  the  output  variable.  To  emphasize  the  focus  on  the  regulator 
design,  set  r(k)  =  0  in  the  structure  shown  in  Figure  3-2.  Let  T^^Jz)  represent  the  nominal 
closed-loop  transfer  function  between  the  manipulated  variable  and  the  disturbance,  that  is, 
u(z)  =  T^^^(z)d(z)  when  A(z)  =  0.  After  carrying  out  elementary  block-diagram  algebra  on 
the  structure  shown  in  Figure  3-2,  it  follows  that 

where 

Uz)  =  -Miz)X{z)  (3.3.10) 

and 

Uz)  =  -M{zf  (3.3.10b) 
Notice  that  both  u(k)  and  d(k)  are  /^-signals  because  they  are  bounded.  Consider  the 
operator  1-norm  \\T^jI^  =X"oi^'i'  ^^^^"^  ('iJ  impulse-response  sequence  of  r^jCz). 
Obviously  ||r„^|||  =  ||r||,,  hence  the  operator  1-norm  is  equal  to  the  li  norm  of  the  impulse 
response  sequence.  Using  the  fact  that  depends  on  the  infinity  norms  of  the  signals 
u(k)  and  d(k)  through  the  relationship  {cf.  Dahleh  and  Diaz-Bobillo,  1995) 

=  suplML  (3  3  11) 

it  follows  that  infinity-norm  constraints  on  the  input  can  be  addressed  by  the  regulator 
design  strategy  by  seeking  to  minimize  (3.3.11).  Hence,  the  problem  of  robust  stability 
with  constraints  on  the  input  can  be  stated  as  the  following  l\/H^  design  problem: 


|i°  =         \\TudA(z)  +  T,j.2(z)Q(z)\[  (3  3.12) 

subject  to 


mz)-T,(z)Q(z)l<l  (3.3.13) 
Clearly,  the  /(  problem  (3.3.12)  addresses  the  nominal  regulation  performance  of  the 
controller,  where  [1°  is  the  maximal  possible     norm  of  the  input.,  that  is,  ||m||^  <  |xo  for 
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all  bounded  disturbances  satisfying  \\d\\^  <  1.  However,  from  Theorem  3.1,  it  follows  that 
the  problem  (3.3.13)  addresses  the  robust  stability  of  the  closed-loop  with  respect  to  the 
modeling  uncertainty. 

The  /]///„  problem  (3.3.12)  -  (3.3.13)  must  be  solved  for  an  optimizing  Youla 
parameter  Q(z)  e  that  minimizes  the  1-norm  of  and  simultaneously  satisfies  the 
infinity-norm  constraint  (3.3.13).  If  the  optimal  solution  satisfies  |a.o  <  P,  then  the  robust 
predictive  regulator  satisfies  the  constraint  specifications  on  the  input.  Conversely,  if 
}X0  >P,  it  can  be  conclusively  stated  that  there  is  no  linear  robustly-stabilizing  predictive 
regulator  that  can  satisfy  the  input  constraints.  Hence,  the  li/H^  design  paradigm 
establishes  the  limit  of  performance  of  the  robust  linear  predictive  control  structure. 


3.4     Synthesis  Procedure 

A  solution  to  the  l^/H^  problem  of  the  type  (3.3.12)  -  (3.3.13)  has  been  proposed  by 
Sznaier  (1994),  who  shows  that  a  solution  can  be  obtained  by  truncating  the  /j  norm  after  a 
finite  horizon  N  to  obtain  ||7LdlU  S"-'oH-  ™^  simplification  leads  to  great 
computational  simplifications  because  the  truncated  /]  problem  and  the  //^problem  can  be 
decoupled  and  solved  sequentially.  A  subtlety  of  the  approach  lies  in  ensuring  that  the 
truncated  /}  performance  measure  also  leads  to  adequate  performance  at  times  beyond  the 
truncation  horizon.  This  is  accomplished  by  introducing  a  bilinear  transformation  that 
places  the  poles  of  the  Youla  parameter  inside  a  circle  of  radius  S<1,  hence  guaranteeing 
the  rapid  decay  of  the  response  modes.  Thus,  the  original  problem  (3.3.12)  -  (3.3.13) 
must  be  transformed  using  the  mapping  z  =  5£  to  yield  operators  of  the  form  G(z)  :  = 
G(^).  The  resulting  transformed  problem  is  denoted  as  l^/H^^. 

The  ////oo  5  problem  considered  in  Sznaier  (1994)  is  of  the  form 


Hl_     inf    f[{z)  +  %{z)Q{z) 


(3.3.14) 
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subject  to 


R(z)-Q(z) 


(3.3.15) 


The  accuracy  of  the  solution  //^  depends  on  the  truncation  horizon  N.  Sznaier  (1994) 
shows  that  as  5  ^  1,  the  modified  solution  satisfies  fx^  <  ji'^  <  fi^  +  e  provided  that 


N  >  NO  =  [log  e(l-^  -  log  K]  /  log  5 


(3.3.16) 


where  K  := 


T^iz)  +  T2{z)  +(i-r)  m 


.  Let 


11^(^1  := 


y^R^R  ■ 

(0 

0 

0  ■ 

■•     0  \ 

dR 

•  •     ^R^R  ^R 

0 

91  • 

0 

dR 

+ 

0 

0 

(Jo  ■ 

Cl^R 

0 

0 

0 

dR  ) 

.0 

0 

0  • 

(3.3.17) 


where  R{z)  :=  c«(£/  -  A^j'hf,  +  J^,  jc  :=  4'^  y  :=  L;/^  and  and  are  the  discrete 
controllability  and  observabiUty  grammians  of  RiX),  respectively. 

Theorem  3.2.  A  suboptimal  solution  to  the  l\/H^  ^  problem  (3.3.14)  -  (3.3.15) 
with  cost      < /j.'^  <  jig  +  £  is  given  by 

(2(1)=  m)+z-'m)  (3.3.17b) 

where  2f(5)  =  X,-o'^'^  '  "^^^^  9°  =  (<?„,■  ••<?jv-ir  solves  the  finite-dimensional  convex 
optimization  problem: 


q°  =  argmin     +  Tq\\ 

Il^(9)l2^r 


(3.3.18) 


and  where  Q'^(z)  solves  the  unconstrained  Nehari  extension  problem 

e^(z)^  argmin  m-Q'riz)- t'Q.iz) 

with    and  x  given  by 


(3.3.19) 
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'10 


'20 


0 


^20  0 


0 


^21      ^20  J 


(3.3.20) 


where  R{z)&  HI,  and  f,,,  /j,-  and      are  the  first  N  impulse  response  coefficients  of 
t,d.\(z),  T^d.i^i)^  and  Qr{z),  respectively,  and  N  is  selected  according  to  (3.3.16). 
Proof.  See  Theorem  2  in  Sznaier  (1994). 

Hence,  from  Theorem  3.2,  it  is  possible  to  construct  a  solution  to  the  l\/H^  ^  problem 
by  solving  the  finite-dimensional  constrained  optimization  problem  (3.3.18)  using  a 
numerical  method  for  nondifferentiable  optimization.  Then  the  unconstrained  Nehari 
extension  (3.3.19)  is  solved  using,  for  example,  the  technique  proposed  by  Rotstein  and 
Sideris  (1993).  The  separate  solutions  are  combined  as  indicated  in  (3.3.17b). 

The  lilH^  design  problem  (3.3.12)  -  (3.3.13)  for  robust  predictive  regulation  must  be 
put  in  the  standard  l\/H^  ^  form  (3.3.14)  -  (3.3.15)  in  order  to  exploit  Theorem  3.2  for 
arriving  at  a  solution.  First,  one  must  rewrite  (3.3.12)  -  (3.3.13)  in  terms  of  the  operators 
%{z),  %{.z),  tj_i(z),  andf„j2(£)  obtained  through  the  bilinear  transformation  z  =  dz. 
Second,  transform  the  model-matching  problem  (3.3.13)  into  the  Nehari  extension  problem 
(3.3.15)  by  first  writing  fj(z)=  tpiz)t,p{z)  where  7;,/z)  is  an  is  an  all-pass  function  and 
f„p(z)  is  a  stable  minimum-phase  function.  Then  find  T.  (z)  =  f^pi^/z)  and  carry  out  the 


ap 


stable/antistable  decomposition 


T,;{mCz)=  R{z)  +  KCz) 
where  R(z)  e  H~  and  Rs(z)  e  H^.  Using  the  property  that 
possible  to  write  the  equalities 


(3.3.21) 


T;pCz)Giz) 


GCz) 


,  it  is 


T,{z)-T,{z)Q{z) 
Defining 


T;p(mz)-T„Xz)Q(z) 


mp  ^ 


R(z)  +  R,{z)-T,„^iz)Qiz) 


.(3.3.22) 


QCz)  .=  R.iz)-Trz)Q{z) 


(3.3.23) 
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equality  (3.3.15)  reduces  to  the  desired  form 


m)-TJz)Q(z) 


Riz)-Q(z) 


(3.3.24) 


Third,  using  the  definition  (3.3.17),  rewrite  the  operators  of  the  l\  problem  (3.3.12)  to 
establish  the  equality 


where 


and 


%{z)  =  7:,,(z)+r„,,,(£)r„;'(z)i?,(z) 


(3.3.25) 
(3.3.26) 


%{z)  =  T^j,i{z)T;^,{z)  (3.3.27) 
Hence,  the  desired  l\/H^  ^  problem  in  the  standard  form  (3.3.14)  -  (3.3.15)  follows  from 
(3.3.25)  and  (3.3.24)  using  the  maps  (3.3.23),  (3.3.36)  and  (3.3.27). 

The  synthesis  technique  proceeds  as  follows.  Theorem  3.2  is  used  to  yield  a  solution 
Q  {z)  =  Qliz)  +  VQliz),  which  combined  with  (3.3.23)  yields 

Qiz)  t^{z)[m)  +  z'Q,{z)  +  m))  (3.3.28) 
and  recover  the  original  Youla  parameter  associated  with  problem  (3.3.12)  -  (3.3.13)  using 
the  inverse  bilinear  transformation 

QU)  =  Q,{zl5)  (3.3.29) 
Finally,  the  robust  l\/H^  predictive  regulator  is  implemented  as  shown  in  Figure  3-2, 
making  use  of  the  Youla  parameter  (3.3.29)  and  the  control  operators  N{z),  M(z),  X(z), 
and  Y(z)  defined  in  (3.3.2)  -  (3.3.3). 


3.5  Example 

To  illustrate  the  applicability  of  the  design  technique  developed  in  the  previous 
sections,  consider  a  second-order  nominal  plant  model  that  has  two  poles  outside  of  the 
unit  circle 
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^o(^)=,2_o.6,  +  i.i2  (3-5.1) 

To  show  the  flexibility  of  the  method,  a  multiplicative  uncertainty  description  is  used  here 
to  characterize  the  family  of  plants  to  be  stabilized.  The  uncertainty  weight  is  given  below 
as 

z-0.1111 

^^^^  =  17^  (3-5.2) 

Two  regulators  are  designed:  (/)  a  nominal  predictive  controller  (NPC)  in  the  standard 
RST  form,  and  (//)  a  constrained  robust  predictive  controller  (CRPC)  with  integral  action, 
synthesized  using  the  ////oo,  5  technique  discussed  in  the  previous  section. 

The  nominal  predictive  controller  is  realized  adopting  the  design  parameters  A'^  =  7, 
7V(^  =  3,  and  A  =  0  to  yield  the  RST  polynomials 

R(^)  =  22_o.8008z- 0.1992  (3.5.3) 

S(z)  =  1.4480z'  -  1.6909Z  + 1.1 155  (3.5.4) 

T(z)  =  0. 1 148z'  +  0.3 196z'  +  0. 1965z'  -  0.0523z'  -  0.0757z'  +  0. 1339z'  +  0.236z 

(3.5.5) 

It  can  be  readily  verified  that  the  NPC  design  stabilizes  the  closed  loop  when  the 
uncertainty  A{z)  is  neglected.  However,  the  NPC  controller  is  not  robustly  stabilizing, 
because  it  violates  the  robust  stabihty  condition  (3.3.13),  that  is,  ||7](z)-  r2(z)2(z)||^  =  5.3 
>  1  calculated  using  Q(z)  =  0.  This  implies  that  the  nominal  predictive  controller  will  fail 
to  stabilize  the  closed  loop  for  some  plants  belonging  to  the  family  of  uncertain  plants.  The 
nominal  performance  of  the  NPC  regulator  is  characterized  with  a  peak-to-peak  norm  ^T^Ax 
=  12.14,  which  indicates  that  bounded  disturbances  exist  with  norm  \\d\\^  <  1,  which  cause 
input  sequences  {m^}  displaying  peaks  with  amplitude  values  as  large  12.14.  This  shows 
that  when  the  worst-case  disturbance  is  affecting  the  plant,  the  NPC  design  can  only  cope 
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with  input  constraints  of  the  form  <  j8  only  for  /?  >  12.14.  Tighter  constraints  will 
lead  to  control-action  saturation. 

The  CRPC  design  is  carried  out  as  indicated  in  Section  4.  The  control  operators  M(z), 
N(z),  Y(x)  and  Xfzj  are  produced  using  (3.3.2)  and  (3.3.3).  A  slight  modification  is 
introduced  to  augment  the  plant  with  a  fictitious  integrator  which  is  later  associated  with  the 
final  Youla  parameter,  in  order  to  produce  a  controller  with  integral  action.  Details  have 
already  been  given  in  the  previous  chapter.  The  design  choice  6  =  0.9852  is  used  for  the 
bilinear  transformation  and  the  truncation  horizon  is  selected  as  N  =  150.  Solving  the 
/1///00, 5  problem  yields  a  high  order  Youla  parameter  Q(z),  as  expected  from  the  large  value 
of  truncation  horizon  that  was  selected  to  achieve  better  accuracy.  The  CRPC  design 
obtained  by  combining  the  Youla  parameter  with  the  operators  defined  in  (3.3.2)  -  (3.3.3) 
is  robustly  stabilizing  because  ||7;(z)-  r2(z)Q(z)L  =  0.94  <  1.  Furthermore,  the  nominal 
regulation  performance  is  greatly  enhanced  with  respect  to  the  NFC  case  because  \\T^j\[  = 
1.72,  allowing  the  CRPC  design  to  deliver  saturation-free  dynamics  for  much  tighter 
constraints  {(5  >  1 .72).  The  tolerable  constraint  limit  is  improved  by  a  factor  of  7  over  the 
NPC  design. 

The  Youla  parameter  of  the  CRPC  design  was  simplified  using  simple  model-order 
reduction  techniques  (Safonov  and  Chiang,  1988)  to  yield  an  implementable  transfer 
function  Q(z)  of  order  6.  The  reduced-order  CRPC  controller  displays  no  appreciable 
performance  degradation  with  respect  to  the  full-order  controller  in  terms  of  the  values  of 
the  /,  and  H^o  norms.  Furthermore,  dynamic  simulations  revealed  that  the  two  controllers 
display  virtually  indistinguishable  closed-loop  responses. 

In  Figure  3-3,  the  performance  of  the  nominal  (NPC)  and  robust  (CRPC)  designs  is 
compared  by  carrying  out  a  regulation  test.  In  these  simulations,  the  nominal  model  is 
assumed  to  match  exactly  the  actual  plant,  that  is,  A(z)  =  0.  A  persistent  disturbance  d(k) 
shown  in  Figure  3-3c  is  introduced  at  time-instant  k  =  0,  and  then  has  a  constant  nonzero 
value  at  instant  k  =  50.  Figure  3-3b  shows  the  superior  performance  on  the  CRPC  design 
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Figure  3-3.  Comparison  of  the  performance  of  the  NPC  regulator  and  the 
robust  (CRPC)  regulator  designed  for  an  exactly-known  plant,  a)  output,  b) 
input  and,  c)  disturbance. 
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which  produces  a  much  more  attenuated  sequence  of  control  actions  {u(k)}  as  a 
consequence  of  the  smaller  value  of  the  norm  ||7^,j||,  ■  Figure  3-4b  shows  that  the  NPC 
develops  peaks  of  magnitude  as  high  as  12  whereas  the  CRPC  design  leads  to  much 
smaller  magnitudes  which  are  no  larger  than  1.5.  This  effect  is  clearly  a  consequence  of 
the  1 1  part  of  the  CRPC  design  which  deliberately  attenuates  the  magnitude  of  the  maximal 
input  peak.  Hence,  the  CRPC  design  is  inherently  capable  of  satisfying  tighter  saturation 
constraints.  Finally,  Figure  3-4a  shows  the  output  responses  where  the  CRPC  controller 
also  displays  far-improved  performance.  The  superior  output  performance  is  a  side  benefit 
of  the  CRPC  controller  since  the  design  was  obtained  without  explicitly  aiming  to  minimize 
the  /)  norm  of  the  output.  Note  that  the  CRPC  regulator  rejects  the  effect  of  the  constant 
disturbance  after  instant  k  =  50  due  to  the  built-in  integral  action. 

Further  insight  into  the  simulation  results  reported  in  Figure  3-3  can  be  gained  with 
another  regulation  test  where  the  manipulated  variable  u(k)  must  satisfy  the  saturation-type- 
constraints  -1.8  <  u(k)  <  1.8.  The  same  disturbance  d(k)  shown  in  Figure  3-3c  is 
introduced  in  the  output  of  the  plant.  The  superiority  of  the  CRPC  design  is  demonstrated 
in  Figure  3-4a  where  it  is  shown  that  the  introduction  of  the  disturbance  produces  an 
unfavorable  output  response  for  the  NPC  design  with  peaks  of  magnitude  between  2  and  7 
over  a  prolonged  period  of  time.  However,  the  CRPC  regulator  successfully  rejects  the 
disturbance  quickly  and  efficiently,  demonstrating  peaks  with  magnitude  less  than  2.  The 
unacceptable  performance  of  the  NPC  controller  is  a  consequence  of  the  input  saturation 
(Figure  3-3b),  and  the  fact  that  the  plant  is  open-loop  unstable.  Furthermore,  Figure  3-3b 
shows  that  the  CRPC  regulator  satisfies  the  input  constraint,  avoiding  saturation.  The 
results  can  be  even  more  dramatic  if  the  saturation  limits  are  lowered  to  values  less  than 
1.78.  In  that  case,  the  NPC  is  not  able  to  stabilize  the  system  in  the  presence  of  the 
saturation  constraints  and  the  disturbance  shown  in  Figure  3-3c.  The  CRPC  design  still 
performs  well  with  saturation  limits  between  1.2  and  1.8  for  the  same  disturbance.  Finally 
on  the  last  regulation  test,  a  different  unstable  plant  belonging  to  the  uncertain  family 


59 


-6  - 

.g  r   '    ■    '    '  '   I    I    I  1—1  I    I    I    I  I — I — I — 

0  50  100  150  200 


0  50  100  150  200 

Time,  k 


Figure  3-4.  Comparison  of  the  performance  of  the  NPC,  and  the  CRPC 
regulator,  when  the  input  u(k)  satisfies  the  saturation  constraints  -1.8<  u(k) 
<  1.8. 

characterized  by  the  weight  in  (3.5.2)  is  used.  The  same  disturbance  as  in  the  previous  two 
regulation  tests  is  used  to  compare  the  two  designs.  The  results  are  shown  in  Figure  3-5 
where  it  is  clear  that  the  NPC  design  is  destabilizing  while  the  CRPC  regulator  successfully 
rejects  the  disturbance.  The  instability  of  the  NPC  design  in  this  case  is  due  to  the  fact  that 
a  plant  different  than  the  nominal  one  was  used  and  shows  the  inability  of  the  NPC 
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regulator  to  be  robustly  stabilizing.  The  CRPC  regulator  efficiently  stabilizes  the  plant  with 
mild  control  action  as  shown  in  Figure  3-5b. 

For  completeness,  it  is  reported  here  that  a  purely  design  may  yield  a  lower  value  for 
the  one  norm  (||7^,j|||  =  1.27),  but  the  resulting  controller  is  not  internally  stabilizing  because 
the  Youla  parameter  is  such  that  Q(z)  ^  °°-  However,  an  unconstrained  design  may 
yield  a  better  value  for  the  oo  norm  {\\T^{z)  -  T^iz)Q{z)\\^=  0.84),  but  the  norm  is  too 
large  (||7;„||,  =3.82). 

3.5  Conclusions 

A  systematic  l^/H^  method  for  robustifying  predictive  regulators  is  proposed  for 
control  system  design  in  the  presence  of  constraints  on  the  manipulated  variable. 
Experience  with  these  methods  shows  that  while  the  unconstrained  design  technique  leads 
to  controllers  of  reasonable  order,  the  constrained  design  is  likely  to  result  in  very  high- 
order  controllers.  Although  model  reduction  techniques  may  be  used  to  successfully 
approximate  the  /,/?/„  regulator,  the  model  reduction  process  may  not  be  required  given  that 
large  controller  orders  are  deemed  acceptable  in  predictive  control  schemes  where  high- 
order  convolution  models  are  used  to  represent  the  nominal  plant. 
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Figure  3-5.  Comparison  of  the  performance  of  the  NPC  and  the  CRPC 
regulator,  designed  for  a  perturbed  plant  belonging  to  the  uncertainty 
description. 


CHAPTER  4 

ROBUST  STABILIZATION  OF  BILINEAR  SYSTEMS  WITH  INPUT 

SATURATION 

4.1  Introduction 

Bilinear  systems  are  a  special  class  of  nonlinear  systems  that  has  attracted  much 
attention  in  the  last  two  decades  (Mohler,  1991).  This  interest  is  due  to  the  fact  that  many 
engineering,  biological,  ecological,  socioeconomic,  and  nuclear  processes  have  been 
shown  to  be  more  accurately  described  in  terms  of  a  bilinear  model  (Mohler  and  Kolodziej, 
1980).  Over  the  years,  a  number  of  publications  have  been  devoted  to  the  analysis  of  the 
structural  properties  and  the  problems  of  identification,  estimation,  and  stabilization  of 
bilinear  systems  (Benallou,  et  al,  1988;  Mohler,  1991;  and  their  references).  Some  of  the 
different  stabilizing  control  approaches  include  Genesio  and  Tesi  (1988),  where  output 
feedback  is  used  to  stabilize  a  SISO  bilinear  system  and  Benallou,  et  al.  (1988),  where 
quadratic  state  feedback  is  used  to  stabilize  a  MIMO  bilinear  system  and  optimize  a  special 
quadratic  cost.  In  Longchamp  (1980),  sliding  modes  are  used  to  derive  a  discontinuous 
control  law  for  SISO  bilinear  systems.  The  local  stabilization  of  the  origin  is  guaranteed  if 
certain  conditions  are  satisfied.  Finally,  in  Yang,  et  al.  (1989),  sufficient  stabilizability 
conditions  are  given  for  time-varying  bilinear  systems  via  output  feedback. 

Many  practical  control  problems  involve  constraints,  such  as  actuator  saturation.  The 
stability  of  linear  systems  with  saturating  actuators  assuming  exact  knowledge  of  the  plant 
has  been  studied  extensively  (Bernstein  and  Michel,  1995;  Bitsoris  and  Vassilaki,  1988; 
Chen  and  Wang,  1988;  Krikelis  and  Barkas,  1984;  Lin  and  A.  Saberi,1993;  Sussmann,  et 
al,  1994),  however,  this  is  not  the  case  for  bilinear  systems.  In  addition,  the  mathematical 
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modeling  of  physical  systems  always  involves  some  kind  of  uncertainty  associated  with  the 
nominal  model.  For  uncertain  linear  systems,  modified  Riccati  equations  (Kim  and  Bien, 
1994)  and  Lyapynov  functions  with  a  subsequent  quadratic  optimization  (Tarbouriech,  et 
ai,  1994)  have  been  used  to  treat  the  saturation  problem.  Apparently,  there  is  a  lack  of 
results  in  the  literature  on  the  stabilization  of  uncertain  bilinear  systems  with  input 
saturation  (when  no  uncertainty  is  present,  see  Niculescu,  et  al.  (1995)).  We  are  thus 
motivated  to  study  the  robust  stabilization  of  input-constrained  bilinear  systems  in  the 
presence  of  uncertainty. 

In  this  chapter,  a  state-feedback  control  law  is  used  to  locally  stabilize  a  continuous- 
time  multiple-input  multiple-output  (MIMO)  bilinear  system  subject  to  actuator  saturation. 
Then,  robust  stability  tests  are  developed  in  the  form  of  sufficient  conditions  that  guarantee 
the  stability  of  the  saturating  nonlinear  system  in  the  presence  of  norm-bounded 
perturbations.  The  derived  conditions,  given  in  terms  of  scalar  matrix-norm  inequalities, 
are  characterized  by  their  simplicity  and  ease  of  calculation.  Two  uncertainty  descriptions 
are  included,  namely,  a  nonlinear  bounded  perturbation,  and  linear  bounded  perturbations 
on  the  system  matrices.  The  detailed  stability  analysis  is  carried  out  for  the  general  bilinear 
regulator  problem,  avoiding  any  simplifications  on  the  structure  of  the  system 
(homogeneous  or  dyadic  models,  for  example). 

4.2  Preliminaries 

The  matrix  measure  is  a  function    :  C"""  —>  R 

||/  +  £A|[-1 
u(A)  =  lim  — 

where  ||  •  ||  is  an  induced  matrix-norm  on  C""" .  For  the  usual  1 ,  2  and  infinity  induced 
norms,  the  matrix  measure  is  given  by  the  following  simple  formulas,  respectively: 


^i(A)  =  max 

j 
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V 


/x„(A)  =  max 


Re(a,)  +  2'«<;' 


where  A*  is  the  hermitian  of  matrix  A,  and  represents  the  maximum  eigenvalue.  Some 
matrix  measure  properties  that  will  be  of  use  are: 

(i)  fj.{  )  is  a  convex  function, 
07)  ^i5A)  =  5ii{A),  and 
m  ReA(A;<//(A;, 

where  A  is  any  eigenvalue  of  the  matrix  A.  A  class  of  matrix  pairs  (A,  B),  A  e  JB 
G  /?nxm^  lg  introduced  for  the  stabilization  problem,  defined  as 

Z/:=  {(A,fl)|3  F  G  /?"^'",H'  G  [0, 1) :  //(a  +  ^^f)  <  o} 

The  matrix  class  corresponds  to  the  class  of  systems  for  which  there  exists  a  state- 
feedback  law  u{t)  =  Fx{t)  such  that  //(a  +  ^^^f)  <  0. 

4.3     Main  Results 

Consider  an  input-constrained  uncertain  bilinear  MIMO  system  described  by  the 
equations 

ffl 

x{t)  =  Ax{t)  +  Bsatu{t)  +       ■x{t)satu-{t)  +  g{.x{t\t)  (4. 1 ) 

1=1 

y{t)  =  Cx{t)  (4.2) 

where  x(t)  =  [xj  ...  xj^  g  /?"  is  the  state  vector  with  initial  state  jc(0)  =  XQ,u(t)  = 
[uj  U2  ...w„,]^  G        is  the  input  vector,  and  y(t)  =  ^y,  y.^  ...y^^  R^  is  the  output 

vector,  and  A,  B,  Nj,  and  C  are  constant  real  matrices  of  appropriate  dimensions.  The 
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vector  function  g(x(t),t)  e  i?"  represents  a  nonlinear  modeling  uncertainty  with  the 
property 

||g(x(O,0||^7lk(O||  (4.3) 
where  7  is  a  positive  real  constant  and  the  operator  ||  •  I  represents  a  vector  norm.  The 
saturation  function  sat  u(t)  is  defined  as  follows  (see  Figure  4-1): 


sat  «(0  =  [sat    (t)  sat    (t) ...  sat  m„,  it)J 


where 


sat  u-(t)  =  • 


M,  ,     M,  <  M, 

Mp    M,  <  M,  <  M,      ,    i  =  1,2,..., m 

U.,  U->U. 


(4.4) 


(4.5) 


and  M,  and  m,  are  real  scalars  representing  lower  and  upper  saturation  limits,  respectively. 
The  objective  is  to  find  the  state  feedback  control  law 

u{t)  =  -Fxit)  (4.6) 
where  F  is  a  constant  matrix,  that  renders  the  closed-loop  (4.1)  -  (4.2)  and  (4.6) 
asymptotically  stable  for  all  modeling  uncertainties  that  satisfy  the  norm  bound  (4.3). 
Based  on  the  definition  of  the  vector-norm  function,  it  is  easy  to  verify  that 


sat  u{t)  -  ■^m(0 


^\Ht)\\ 


(4.7) 


It  should  be  noted  that  inequality  (4.7)  is  used  here  because  of  its  simplicity  to  facilitate  the 
exposition  of  the  ideas  in  this  chapter  (see  also  Chen  and  Wang,  1988;  Niculescu,  et  al, 
1996;  Krikelis  and  Barkas,  1984  where  (4.7)  is  used).  Other  possibly  less  conservative 
conditions  may  be  used  in  conjunction  with  the  developments  below.  The  interested  reader 
is  referred  to  Kim  and  Bien  (1994);  Niculescu,  et  al.  (1995);  and  Tarbouriech,  et  al.  (1994) 
where  alternative  conditions  to  (4.7)  are  used.  Theorem  4. 1  gives  conditions  that  guarantee 
the  asymptotic  stability  of  the  closed  loop: 
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i 

satUi  ^ 

U- 

slope    1  / 
/ 

slope  =  r 

Figure  4-1.  Actuator  saturation  with  bounds  u  -  and      and  sectors  [0,1] 
(slope  =  1),  and  [r,l]  (slope  =  r). 

Theorem  4.1.  Suppose  that  the  nonlinear  perturbation  in  the  constrained  bilinear 
system  (4.1)  -  (4.2)  satisfies  (4.3).  Let  the  robust  state-feedback  matrix  F  be  chosen  to 
satisfy  the  inequality 

Li{A-{BF)  +  {\B\\F\  +  Y  <Q 

(4.8) 

Then,  the  uncertain  constrained  bilinear  system  is  asymptotically  stable  if  the  initial  state 
belongs  to  the  region  of  attraction  defined  by  the  inequality 

^{A-\BF)  +  \\B\\F\  +  Y 


Fo||<  — 


Proof.  From  (4.1)  and  (4.6),  the  closed-loop  system  is  written  as 


(4.9) 


x{t)  =  Ax{t)  +  -Bu{t)  +  B 


sat  u{t)--u{t) 


=  Ax{t)  +  B 


sat  u{t)--u{t) 


+  Y,N,x{t)satu,{t)  +g{x{t),t)  (4.10) 

1=1 

J^N.,x{t)satu,{t)  +  g{x{t),t)  (4.11) 
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where  the  term  jBu{t)  has  been  added  and  subtracted  in  (4. 10),  and  where  A  =  A-{BF . 
The  solution  to  (4.1 1)  for  t  >  0,  can  be  expressed  as  the  integral  equation 

x{t)  =  e^'x,  +  jy"-''[B[sat  u{s)  -  \uis)]  +  J" ,  N,x{s)sat{-F.x(s))  +  g{x(s),  5)^5(4.12) 
where  u.{t)  =  -F.x{t)  where  F-  is  the  i-th  row  of  matrix  F.  Taking  the  norm  of  both  sides 
in  (4.12),  using  the  inequaUty  (Vidyasagar,  1993) 


"\\<e^^^^',  t>0 


(4.13) 


(4.15) 


and  invoking  (4.7)  yields 

||x(r)||  <  e^*^*'||xo||  +  mu(s)\\  +         N^x{s)sat{-F,x{s))\  +  \\g{x(s),  s)\i^ds 

<e'^''\\x,\\  +  \>'^'-'\^\B\\\\Fl^ 
where  we  have  used  the  inequalities 

A^,x(.).ar(-/=;x(5))||  <  i;jM|f;x(5)||^(5)|| 

Now  consider  the  scalar  differential  equation 

at) = [ma  ) + iiifi|iiiFii + r]z{t) + x;:,||iv,||llF||z(o^  t  >  o 

2(0)  =  lko|| 

The  solution  of  (4.16)  is  unique  and  is  given  by  the  expression  (Bellman,  1970) 

zit)  =  e'^^'ziO)  +  j^e"'^'*'-^' y)zis)ds  +  £e''<^'<'-^'X"l,ll^.ilM^(^)'^^  (4. 17) 
From  inequality  (4.14),  it  follows  that 

\\x{t)\\<z(t),  forr>0  (4.18) 
therefore,  asymptotic  stability  for  (4.16),  that  is,  z(t)^0  when  t  oo,  implies  asymptotic 
stability  for  the  original  system  (4.1 1).  From  the  Poincare-Lyapunov  theorem  {cf.  Bellman, 
1970),  it  follows  that  (4.16)  is  asymptotically  stable  if  ;U(A)  +  ^||fi||||F||  +  7  <  0  and  if  zfOj 

is  sufficiently  small.  The  asymptotic  behavior  of  z( t)  as  a  function  of  z(0)  is  examined  in 


(4.16) 
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detail  in  the  next  paragraph  (see  case  (/)),  where  it  is  shown  that  for  a  nonlinear  differential 
equation  of  the  form  of  (4.16)  z(t)     0  as  t  ^  °°  when  the  initial  state  satisfies 

The  asymptotic  behavior  of  a  nonlinear  equation  of  the  type  of  (4.16)  is  examined  in 
some  detail  in  this  paragraph.  Consider  the  nonlinear  differential  equation 

z(t)  =  az(t)  +  bz(tf  (4. 16  A) 

where  b>0,a^O,  and  z(0)  =  Zq.  The  solution  z(t)  of  (A)  can  be  obtained  using  separation 
of  variables  and  integrating  to  get 

zit)=      ^^''"l     ,  (4.16B) 

The  equilibrium  points  of  (4.16A)  are  found  by  setting  the  derivative  of  z(t)  equal  to 
zero  to  obtain  z,  =  0  and  Z2  =  -a/b.  The  asymptotic  behavior  of  the  solution  (as  t  oo) 
depends  on  the  sign  of  a,  and  on  the  initial  condition  Zq  as  follows: 

(/)  If  a  <  0,  then  zit)-^0  for  Zq  <  -b/a,  and  z(t) °°  in  finite  time  for  all  Zg  >  -b/a. 
{ii)    If  a  >  0,  then  z(t)     -b/a  for  Zq  <  0,  and  z(t)^oo  in  finite  time  for  all  Zo>  0. 

The  following  remarks  are  in  order: 
1 .  The  bounds  obtained  using  the  sufficient  conditions  (4.8)  and  (4.9)  vary  with  the 
chosen  norm  and  the  corresponding  matrix  measure  (Vidyasagar,  1993).  It  is 
possible  therefore,  that  with  a  given  norm  and  matrix  measure,  one  can  conclude 
stability,  while  with  others  the  stability  condition  may  not  hold.  In  particular, 
adopting  the  1  or  infinity  vector  norms  simplifies  the  computations,  avoiding  possibly 
more  expensive  singular-value  calculations.  The  problem  of  choosing  a  suitable 
norm  and  matrix  measure  to  improve  the  stability  condition  resembles  that  of  finding 
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an  appropriate  Lyapunov  function  in  the  well  known  and  widely  used  Lyapunov 
techniques  for  determining  stability. 

An  alternative  to  the  original  problem  formulation  (4.1)  -  (4.2)  would  be  to  consider 
^"'_^N-xsatu^  +  g(x,t)  as  a  norm-bounded  perturbation,  which  eliminates  the 
bilinearity  of  the  system  and  thus  apply  results  developed  for  linear  uncertain  systems 
with  saturation  (Kim  and  Bien,  1994;  or  Niculescu,  et  ai,  1996).  Of  course,  this 
would  yield  rather  conservative  results,  since  the  model  would  allow  for 
perturbations  that  may  never  occur  in  the  actual  system. 

In  order  to  reduce  conservatism  in  the  developed  sufficient  conditions,  one  could  use 
a  different  condition  in  place  of  (4.7),  as  in  the  approaches  of  Kim  and  Bien  (1994) 
and  Tarbouriech  et  ai,  (1994).  It  should  be  noted,  however,  that  the  conditions 
developed  here  are  in  a  sense  simpler  to  use  than  solving  modified  Riccati  equations 
(Kim  and  Bien,  1994)  or  following  a  Lyapunov  function  approach  that  includes 
solving  a  quadratic  optimization  problem  (Tarbouriech  et  ai,  1994). 
Theorem  4. 1  concerns  a  nonlinear  saturation  that  lies  in  the  sector  [0,  1]  as  defined  in 
(4.4)  -  (4.5).  The  results  of  Theorem  4. 1  can  be  improved  when  the  saturation 
nonlinearity  lies  inside  a  finite  sector  [r,  1],  0  <  r  <  1  as  shown  in  Figure  4-1 
(Vidyasagar,  1993).  In  this  case,  (4.7)  becomes 


satu{t)-^il  +  r)uit) 


<|(l-r)||«(r)|i  (4.19) 


2 

and  conditions  (4.8)  -  (4.9)  of  Theorem  4. 1  are  written  as 

//[A        +  r)BF]  +  {(1  -  +  r  <  0  (4.20) 

with  the  domain  of  attraction 

"°'  11^11 
Besides  the  well-known  1,  2,  and  infinity  norms,  other  induced  norms  and  matrix 
measures  involving  weighting  parameters  may  be  utilized  to  reduce  conservativeness  in  the 
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stability  conditions.  As  an  example,  consider  the  following  matrix  norm  and 
corresponding  measure  (Mori,  et  ai,  1983) 

lAt  =maxX.-^|«,y|  ,  flAA)-max[a,  +  J^^^'-y-\a^^\]  (4.14) 
Optimization  with  respect  to  the  arbitrary  weighting  parameters  w,  is  likely  to  yield  less 
conservative  robust  stability  conditions.  This  topic  merits  further  investigation  and  is  not 
pursued  here.  Also,  similarity  matrix  transformations  can  be  used  to  reduce 
conservativeness  in  the  robustness  conditions.  Consider  a  transformation  matrix  T  such 
that  r-'  exists  and  the  pair  {T-^AT,  T  B)  belongs  to  the  class  U.  Then,  conditions  (4.8) 
and  (4.9)  of  Theorem  4. 1  can  readily  be  written  as 

^{T-'AT-\T-'BF)  +  ^\T-'B\\F\  +  y' <0  (4.22) 

and 

//(r-'AJ  -  \  TBF)  +  +  y' 

"'^ " '  rran   '  ' 

A^i=\\\       '  II II  II 

where  /'  is  the  bound  in  ||7"'g(Af,r)||  <  7'|[j^(0||-  Thus,  matrix  T  can  be  selected  in  order  to 
satisfy  (4.22),  and  simultaneously  increase  the  region  of  attraction  if  ||r"'A^,T||  <  ||iV.||  is 

satisfied  for  some  /.  How  to  find  the  optimal  T,  though,  is  still  an  open  research  question. 

Corollary  4.1.  Consider  the  bilinear  system  with  perturbed  matrices  A,  B  and  A^, 
given  by 

m 

x{t)  =  {A  +  AA)xit)  +  {B  +  AB)satu{t)  +  ^{N,  +  AN^)xit)satu.{t)  (4.24) 

(=1 

where  the  matrix  perturbations  satisfy  the  norm  bounds 

||AA|<a,   \\AB\\<p,   ||AA^,||<v,  ,   /  =  1,2,...,«  (4.25) 
Then,  the  closed-loop  system  is  asymptotically  stable  if 

l2[A-Hi  +  r)BF]  +  a  +  H\-r){\\B\\  +  (5)\\F\\  <  0  (4.26) 

and 
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II    II      /l[A  - 1(1  +  r)BF]  +  g  +  id  -  r)(||g||  +  fi) \\F\\ 

i;;,(ii^.ihv,)iiFii 

Proof.  It  is  analogous  to  the  proof  of  Theorem  4. 1  and  follows  readily  after  invoking 
(4. 19)  in  place  of  (4.7),  and  using  the  bounds  (4.23)  instead  of  (4.3).  ♦ 

It  is  useful  to  accompany  the  sufficient  stability  conditions  derived  thus  far  for  an 
uncertain  bilinear  system  with  a  Design  Procedure  for  the  selection  of  an  appropriate 
feedback  matrix  F. 

From  the  previous  analysis,  an  iterative  procedure  can  be  proposed  as  a  guideline  for 
selecting  the  matrix  F  to  satisfy  the  robust  stability  conditions,  (see  Chen  and  Wang,  1988; 
Kim  and  Bien,  1994  for  the  linear  case) 

Step  1:  Check  the  norm  bound  of  the  plant  uncertainty  and  select  distinct  negative 
eigenvalues  A,  /  =1,2,  ...  n. 

Step  2:  Find  the  control  law  matrix  F  using  a  standard  eigenvalue-assignment 
technique.  Then,  check  whether  condition  (4.8)  is  satisfied.  If  so  stop;  a  robust  matrix  F 
has  been  obtained,  otherwise,  continue  with  Step  3. 

Step  3:  Shift  the  system  eigenvalues  to  the  left  using  A,  =  A,  -  /  =1,  2,  ...  n. 
where  AA,  >0;  then  go  back  to  step  1. 


4.4  Example 

Consider  an  uncertain  bilinear  system  defined  as  in  (4. 1)  with  dynamics  described  by 


"0.1 

-0.2' 

,  b  = 

'i.r 

,  N  = 

'  0  -0.2' 

0.8 

-2.1_ 

_0.2_ 

0.1  0 

and  the  nonlinear  uncertainty  bound  /=  0.3.  The  operational  range  of  the  saturating 
actuator  lies  in  the  sector  [1/3,  1],  and  therefore,  inequalities  (4.20)  and  (4.21)  will  be  used 
as  prescribed  by  Remark  4.  Notice  that  the  open-loop  system  is  unstable  since  matrix  A 
has  one  positive  eigenvalue. 
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By  a  standard  pole-placement  technique,  we  take  the  eigenvalues  of 
A  =  A-^1  +  \)bF  to  be  -2.09  ±  0.4i  and  then  find  the  feedback  matrix 

F  =  [2.95   0.25].  Using  condition  (4.20)  now,  the  usual  1,  2,  and  infinity  norms  are 

obtained. 

For  the  1-norm,  ^[A-|BF]-i-^||fi|||F||-f-7  =  0.03  >  0,  therefore  nothing  can  be 

concluded  concerning  the  stability  of  the  system. 

For  the  2-norm,  ^[a  -^BF]  -h  ^1|B||||F||  -H  7  =  -0.658  with  a  corresponding  region  of 

attraction  given  by  \\xq\\   <  1.11  while  for  the  c«-norm,  ;u[A-|flF]-t-^||fl||||F||-i-7  = 

-0.298  with  IIjcJ  <  0.506.  Therefore,  it  follows  from  Theorem  4.1  and  remark  4  that  the 

bilinear  system  is  asymptotically  stable  with  a  region  of  attraction  which  is  at  least  ||xo||  < 

1.11. 

When  there  is  no  uncertainty  present,  the  results  are  even  better;  using  the  2-norm 

which  for  this  example  gives  the  largest  bound,  the  following  is  obtained: 
/i[A  - 1  fiF]-i-^||B|| II F II +  7  =  -0.9581  with  an  adequate  region  of  attraction  given  bylxj 

<  1.618.  It  should  be  noted  that  the  approach  of  Lin  and  Saberi  (1993)  and  Sussmann,  et 

al.  (1994)  developed  for  open-loop  stable  linear  systems  cannot  be  applied  in  this  example 

since  A  is  not  hurwitz.  Also,  in  Longchamp  (1980),  an  example  is  given  with  a  much 
smaller  region  of  attraction  (||xo||  <  0.255),  which  is  claimed  to  be  large  enough  for  many 

practical  applications. 

4.5  Conclusions 

In  this  chapter,  results  derived  for  linear  systems  are  extended  to  bilinear  systems  with 
a  subsequent  characterization  of  the  region  of  attraction.  Theorem  4. 1  and  Corollary  4. 1 
yield  sufficient  conditions  for  the  robust  stabilization  of  general  bilinear  systems  via  state 
feedback.  The  easily  calculable  conditions  are  expressed  in  terms  of  matrix  norms  and 
measures,  and  do  not  require  the  solution  of  Riccati  or  Lyapunov  equations. 
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A  central  requirement  is  that  the  matrix  measure  of  the  closed  loop  matrix  can  be  made 
negative  enough  by  appropriate  linear  feedback  to  overcome  the  effect  of  perturbations. 
Current  and  future  research  will  focus  on  extending  the  results  to  the  case  in  which  some  of 
the  states  are  not  available,  and  therefore  must  be  estimated  via  an  appropriate  extended 
Kalman  filter.  Finally,  a  trial-and-error  design  procedure  has  been  proposed  to  find  the 
feedback  matrix,  and  an  example  is  given  to  illustrate  the  results. 


CHAPTER  5 

ROBUST  STABILIZATION  OF  DELAYED  BILINEAR  SYSTEMS 

5.1  Introduction 

Bilinear  systems  as  a  simple  class  of  nonlinear  systems  have  received  continuous 
attention  in  the  literature  for  approximately  twenty  five  years  (Mohler  and  Kolodziej, 
1980).  Such  interest  may  be  due  to  the  fact  that  various  processes  in  engineering  and 
science  can  be  modeled  as  bilinear  systems.  The  earlier  publications  in  the  field  are  mostly 
concerned  with  the  analysis  and  structural  properties  of  bilinear  systems  (Mohler,  1991). 
Later,  optimal  control  theory  and  quadratic  performance  indices  were  used  for  the  design  of 
controllers  for  bilinear  systems  (c/.  Benallou,  et  ai,  1988;  and  included  references).  The 
stability  of  exact  bilinear  models  has  also  been  studied  using  various  methods  (Mohler, 
1991;  Genesio  and  Tesi,  1988;  Longchamp,  1980;  and  Yang,  etal.,  1989). 

It  is  well  known  that  various  engineering  systems  involve  time  delays  in  the  state 
and/or  the  control  variables.  These  time  delays,  which  are  often  ignored  to  make  the 
theoretical  analysis  simpler,  can  be  a  source  of  instability.  For  this  reason,  much  work  has 
concentrated  on  the  analysis  of  linear  systems  with  delays  (c/.  Choi,  1994;  Chen  and 
Latchman,  1995;  and  their  references).  In  contrast,  the  corresponding  problem  of 
analyzing  the  stability  of  bilinear  time-delay  models  has  not  been  given  comparable 
attention.  In  a  recent  publication,  Lu  and  Wey  (1993)  examine  the  stability  of  a  bilinear 
system  with  delay  in  the  state,  and  derive  a  sufficient  condition  using  the  Lyapunov  direct 
method.  The  Lu-Wey  approach  assumes  that  the  system  model  is  exactly  known, 
however,  the  mathematical  modeling  of  physical  systems  always  involves  uncertainties 
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associated  with  the  nominal  model.  The  treatment  of  uncertain  bilinear  systems  with  time 
delays  and  their  stability  properties  appears  to  be  completely  absent  from  the  literature. 

In  this  chapter,  a  state-feedback  controller  approach  is  employed  to  stabilize  a 
continuous-time  multiple-input  multiple-output  bilinear  system  with  delay  in  the  state 
variables.  The  nominal  bilinear  model  used  by  Lu  and  Wey  (1993)  is  extended  to  include 
new  elements  representing  nonlinear,  possibly  time-varying  modeling  uncertainty. 

5.2  Preliminaries 


The  matrix  measure  is  a  function  n  :  C"""  — >  R 

Li{A)  =  lim  ^  ^ — 

where  ||  I  is  an  induced  matrix-norm  on  C""".  For  the  usual  1,  2,  and  infinity  induced 
norms,  the  matrix  measure  is  given  by  the  following  simple  formulas: 


III  (A)  =  max 


(A)  =  A, 


A*+A 


V  '*J  J 

f  A*    ,  a\ 

V 


Re(a„)  +  Xl«,yl 


//^(A)  =  max 

where  A*  is  the  Hermitian  of  matrix  A,  and      represents  the  maximum  eigenvalue. 


5.3     System  and  Assumptions 

Consider  the  uncertain  MIMO  bilinear  system  with  time-delay  in  the  state  represented 
by  the  equations 
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x{t)  =  A,jc(r)  +  A^xit  -  T)  +  Bu{t)  +  yN.x{t)u.{t)  +  g, (jr(O,0  +  ^2(^(^ "  '^)'0 

(5.1) 

a:(0)  =  9)(6/)    ,    61  €  [-1,0] 

yit)  =  Cx(t)  (5.2) 
where  xf/)  e  /?"  is  the  state  vector  with  initial  state  x(0)  =  x^;  u(t)  e  is  the  input 
vector;  y(t)  g  is  the  output  vector,  and  A,,  fi,  A^,-,  and  C  are  constant  matrices  of 
appropriate  dimensions.  (p(t)  is  a  continuous  vector-valued  initial  function;  and  t>  0  is  the 
time  delay.  The  vector  functions  g^(x(t),t)  e  /?"  and  g2(x(t-t)-t)  e  /?"  represent 
nonlinear  modeling  perturbations  that  depend  on  the  current  state  x( t)  and  the  delayed  state 
x(t-r)  of  the  system,  respectively.  It  is  assumed  that  the  modeling  uncertainties  satisfy  the 
bounds 

\\gMo,t)\\<r,\\xit)\\  ^^-^^ 

and 

\\g,{x{t-T),t)\\<r,\\x(t-t)\\  (5-4) 
where  y^  and  are  known  positive  real  constants,  and  the  operator  ||  •  ||  may  be  any  vector 
norm.  We  will  assume  that  the  following  inequality  is  satisfied  for  all  0  g  [-t,0],  and  all 
real  ^  >  0  (Mahmoud,  1996): 

\\x{t  +  d)\\<q\\xit)\\  ^^^^ 

Similar  assumptions  have  been  used  in  the  context  of  Razumikhin-type  theorems  where 
Lyapunov  functional  are  employed  for  stability  analysis.  For  an  extensive  discussion,  see 
Hale  and  Lunel  (1993).  Note  that  condition  (5.5)  is  not  very  restrictive  since  we  allow  q  to 
adopt  any  value  greater  or  smaller  than  one. 
Using  a  state  feedback  control  law 

uit)  =  Fx{t) 

(5.6) 

where  F  is  a  constant  matrix,  the  objective  is  to  find  sufficient  conditions  that  F  must 
satisfy  in  order  to  asymptotically  stabilize  the  closed-loop  (5.1)  -  (5.2)  and  (5.6)  for  any 
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modeling  uncertainties  that  satisfy  the  norm  bounds  (5.3)  -  (5.4).  Any  matrix  F  that 
stabilizes  the  uncertain  bilinear  system  is  said  to  be  robustly  stabilizing. 

Theorem  5.1:  Suppose  that  the  bilinear  system  (5.1)  -  (5.2)  satisfies  the  uncertainty 
bounds  (5.3)  -  (5.4)  and  inequality  (5.5).  Then,  (5.6)  is  a  robustly  stabilizing  state 
feedback  control  if 

^{A^+BF)  +  q\A^\  +  Y,+qY2<Q  ^^^^ 

and  the  initial  state  lies  in  the  domain  of  attraction  defined  by  the  inequality 

II    |i      /x(A,  +  gF) +    A,  II +  y,+^y, 

'  (5-8) 
Proof:  Let  m,(0  =  F^x{t),  where  F^  is  the  /-th  row  of  matrix  F,  denote  a  component  of 

(5.6).  From  (5.1),  the  closed-loop  system  is  written  as 

  m 

x{t)  =  AxmA^x(,t-T)+'%N.^F^x{t)x{t)  +g,(x{t),t)+g^(x{t-T),t)  (5.9) 

(=1 

where  A  =A^+BF.  The  solution  to  (5.9)  for  r  >  0,  is  readily  expressed  as  the  integral 
equation 

x{t)  =  e~"x,  +  f'e^<'-''Ux(r -  T)  +  YN.F,x{t)xm  gMM  +  g.{xU  -  T),t)  \ds 

•"^        L  /=i  J  (5.10) 

Taking  the  norm  of  both  sides  in  (5.10),  using  the  inequality  (Vidyasagar,  1993) 

<  ^M^),^  r>0  (5.11) 
and  invoking  the  bounding  inequalities  (5.3)  -  (5.5)  yields 

<  e''^"\\x,\\  +  jy^>"-'\q\\A,  II  +  7,  +  qy,)\\x(s)\\ds  (5-12) 
Now  consider  the  scalar  differential  equation 


78 

zit)  =  [^{A)  +  q\\A,\\  +  y,  +qr2]z{t)  +  Y!JM\\nzit)\  t>0 

z(0)  =  ||xo||  (5.13) 

The  solution  to  (5.13)  is  unique  and  is  given  by  the  integral  expression  (Bellman  and 
Cooke,  1963) 

(5. 14) 

From  inequality  (5.12),  it  follows  that 

\\x{t)\\<z(t),   for/>0  ^^-^^^ 

therefore,  asymptotic  stability  for  (5.13),  that  is,  z(t)  ^  0  as  r  ^  0°,  implies  asymptotic 

stability  forx(t).  From  the  Poincare-Lyapunov  theorem  (cf.  Bellman  and  Cooke,  1963, 
pg.  335),  it  follows  that  (5.13)  is  asymptotically  stable  if  id{A)  +  q\\A^ ||  +  7i  +  QYi  <  0  ^""^ 

if  ^fO)  =  Zois  sufficiently  small.  A  characterization  of  the  "smallness"  of  Zq  can  be  obtained 

by  examining  the  asymptotic  behavior  of  z(t)  as  a  function  of  z^.  First,  the  equilibrium 

points  of  (5. 13)  are  found  by  setting  the  derivative  of  z(t)  equal  to  zero  to  obtain  z,  =  0  and 

2^     HiA)  +  q\\A,\\  +  y,+qr2 

'  ~  ~   z'jmm  (5-16) 

The  asymptotic  behavior  of  the  solution  depends  on  the  sign  of 
//(A)  +  9||A2||  +  7, +^72  and  on  the  initial  condition  Zq.  In  particular,  when 
jU(A)  +  qjA^  \\  +  Yi+  qYj  <  0.  then  z(t)  0  for  all  Zq  <  Zj,  and  z(t)  °°  in  finite  time 
for  all  Zo>  Zj-  Using  the  fact  that  Zq  =  \\xj\\  and  recognizing  (5.15),  it  immediately  follows 
that  when  the  inequality  condition  (5.7)  is  satisfied,  then  jc(r)  ->  0  as  r  ->  00  provided  that 
the  initial  state  in  turn  satisfies  the  condition 

11  II     M^)  +  ^||A2||  +  yi+gy2 

♦ 

As  can  easily  be  verified,  the  bounds  obtained  using  the  sufficient  conditions  (5.7)  and 
(5.8)  vary  with  the  chosen  norm  and  the  corresponding  matrix  measure  (Vidyasagar, 
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1993).  It  is  then  possible  that  for  a  given  norm  and  matrix  measure,  one  can  conclude 
stability  while  with  other  matrix  norms,  the  stability  condition  may  not  hold.  Note  also  that 
the  adoption  of  the  1  or  infinity  norms  may  simplify  the  calculafions,  avoiding  possibly 
more  expensive  singular  value  computations.  In  this  respect,  the  problem  of  choosing  a 
suitable  norm  and  matrix  measure  to  improve  the  stability  condition  is  similar  to  the 
problem  of  finding  an  appropriate  Lyapunov  function  candidate  in  the  well-known  and 
widely  used  Lyapunov  techniques  for  determining  the  stability  of  control  systems. 

Theorem  5.1  can  be  further  specialized  to  the  case  where  the  uncertainty  can  be 
described  as  linear  perturbations  of  the  system  matrices.  The  following  result  can  be 
obtained. 

Corollary  5.1:  Consider  the  uncertain  bilinear  system  given  by 

m 

xit)  =  (A,  +  A4,  )x(t)  +  (A,  +AA^)xit  -t)  +  {B  +  AB)uit)  +  X(^'  +  AN,)x(t)u.{t) 

1=1  (5.18) 

with  nominal  matrices  A,B,  and  A^,,  affected  by  respective  perturbations 

AA^,AA,,AB,AN^,   i  =  l,2,...,m,  where  the  perturbations  satisfy  the  norm  bounds 


(5.19) 


|A4,|<a,,   |zU2||<a2,   I^I^A   |/W,||<v,.  ,   i  =  l,2,...,m 

Then,  the  closed-loop  system  is  asymptotically  stable  if 

ju(A,  -I-  BF)  -!-«,+     A2 II  +  «2 )  <  0 

and 

^(A,  -I-  BF)  +  a^+  ^(1 A2 II  +  a2 ) 


(5.20) 


Fo  <— 


s:;,(llA^,ll+v,)||F||  (5.21) 

Proof:  The  proof  is  analogous  to  the  one  given  for  Theorem  5.1  and  follows  readily 
after  invoking  the  bounds  given  in  (5.19)  instead  of  (5.3).  ♦ 
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5.4       Constrained  Control 

The  case  of  control  saturation  is  considered  in  this  section.  An  uncertain  biUnear  time- 
delayed  system  with  input  saturation  can  be  described  by  the  following  equations 

m 

x{t)  =  A^x(t)  +  A^xit  -  T)  +  Bsatu{t)  +  Y^N ■x{t)satu-{t)  +  gx{x{t),t)  +  gjixit  -  x),t) 

(5  ID 

x(d)  =  <t)(d)  ,    -T<d<o  ^  '  ^ 

where  all  the  symbols  are  as  defined  in  Section  5.3,  and  the  saturation  function  sat  u(t)  is 
given  by  (see  Figure  4.1) 

sat  u(t)  =  [satu^it)  satUjit)...  satu„,{t)f 

(5.24) 

where 

M,,     M,.  <M,. 

sat   U;(t)  =  \    Ui,        U:<U-<U:  ,        1=1,2, ...,171 

_'         _  (5.25) 

M,.,     M,.  >M, 

and  where  m,  and  u-  are  real  scalars  representing  lower  and  upper  saturation  limits, 
respectively.  Equation  (5.25)  defines  a  saturation  function  that  lies  in  the  sector  [0,1]. 
Also  of  interest  is  the  case  where  the  saturation  nonlinearity  lies  in  a  sector  [r,l],  0  <  r  <  1, 
as  shown  in  Figure  1 .  The  definition  of  the  saturation  nonlinearity  for  this  case  is  obvious 
from  the  figure. 

Using  the  properties  of  the  vector-norm  function  it  is  easy  to  verify  that 

\\satuit)  -  id  -H  r)«(0||  <  i(l  -  r)||«(0||  (5.26) 

Theorem  5.2.  Suppose  that  the  nonlinear  perturbation  of  the  constrained  bilinear 
system  (5.22)  -  (5.23)  satisfies  (5.3)  -  (5.4).  Let  the  robust  state-feedback  matrix  F  be 
chosen  to  satisfy  the  inequality 

HiA)  +  q\\A,\\  +  id  -  r)||fi||I|F||  +  /,  +  g/^  <  0  (5.27) 
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Then,  the  uncertain  constrained  bilinear  system  is  asymptotically  stable  if  the  initial  state 
belongs  to  the  region  of  attraction  defined  by  the  inequality 

12(A)  +  q\\A,\\  +  id  -  r)||g||||F||  +  7,  +  qy. 


Fo||<  — 


(5-28) 

Proof.  From  equations  (5.22)  and  (5.6),  the  closed-loop  system  is  written  as 


jc(r)  =  A  ,xit)  +  ^(1  +  r)Bu{t)  +  A^xit-T)  +  B 


sat  u{t)  - +  r)u(t) 


+  £  N,x{t)sat  u. it)  +  g,  {x{t),  t)  +  g,  {x{t  -  T), /) 


(5.29) 


j=i 


or  equivalently 


1 


sat  M(0--(l  +  r)M(r) 


x{t)  =  Axit)  +  A  ^xit  -T)  +  B 

m 

+  5^  A^,.jc(0  sat  u,{t)  +  g,{x{t),t)-\-g^ix{t 

/=i 

where  the  term  \{\  +  r)Bu{t)  has  been  added  and  subtracted  in  (5.29),  and  matrix  A  is 
defined  as  A=A^  +  \(\  +  r)BF.  Now  proceeding  on  the  same  vein  as  in  the  proof  of 
Theorem  5.1,  and  taking  the  norm  of  the  integral  solution  of  (5.29)  using  (5.26)  and  (5.1 1) 
and  applying  the  Comparison  Theorem  (Lemma  1),  the  conditions  (5.27)  and  (5.28)  of  the 
theorem  readily  follow. 

Corollary  5.2.  Consider  the  bilinear  state-delayed  system  with  unstructured 
perturbations  in  matrices  A,,  B  and  A^,,  given  by 


i(0  =  (A,  +  zL4,)x(0  +  (Aj  +  AA^)x{t -t)  +  {B  +  AB)satu{t)  +  £(iV,  -I-  AN.)xit)satu.it) 

xid)  =  <i)(d)  ,  -T<d<o 


1=1 


(5.30) 


with  matrix  perturbation  bounds  given  by 

||ziA,.||<a.,   ||zifi||<i3,  ||AA^,||<v, 


(5.31) 


Then  the  closed-loop  system  is  asymptotically  stable  if 


(5.32) 


A/[A,+i(l  +  r)BF]  +  a,+^(||A2+«,||)  +  l(l-r)(||fi||  +  j3)||F||  <  0 

and  the  initial  condition  satisfies 

II    II      /J[ A,  t  i ( 1  +  r)Bf]  +  g,  +        +  g, II)  +  i ( I  -  r)( II B|  +      f  II 

i::,(ll'V,+v,||)||F||  (5.33) 

Proof.  It  is  elementary  to  verify  conditions  (5.32)  and  (5.33)  by  simply  following  identical 
steps  as  in  the  proof  of  Theorem  5.1. 


5.5  Example 

Consider  an  uncertain  bilinear  system  defined  as  in  (5. 1)  with  dynamics  described  by 


"0.1 

-0.2" 

'0.1 

0  ■ 

0.8 

-2.1_ 

,  Aj  — 

_  0 

0.1_ 

"i.r 

'  0 

-0.2' 

,  N  = 

0.2 

0.1 

0 

b  = 

and  the  nonlinear  uncertainty  bounds  7,  =  0.3  and  =  0.  The  operational  range  of  the 
saturating  actuator  lies  in  the  sector  [1/3,  1],  and  therefore,  inequalities  (5.27)  and  (5.28) 
will  be  used  as  prescribed  by  Theorem  5.2.  Notice  that  the  open-loop  system  is  unstable 
since  matrix  A  has  one  positive  eigenvalue. 

By  a  standard  pole-placement  technique,  we  take  the  eigenvalues  of 
A  =  A- -^[l  +  ^)BF  to  be  -2.09  ±  0.4i,  and  then  find  the  feedback  matrix 

F  =  [2.95  0.25].  Using  condition  (5.27)  now,  we  obtain  for  the  usual  1,  2  and  infinity 
norms: 

For  the  1-norm.  //(A)  +  g||A2||  +  ^|lfl||||F||  +  7|  =  0.15  which  is  greater  than  zero; 
therefore  nothing  can  be  concluded  for  the  stability  of  the  system. 

For  the  2-norm,  //{a)-I-^||A2||  + j||fi||||F||-i-7,  =  -0.54  with  a  corresponding  region  of 
attraction  given  by  \\xq\\  <  0.91  while  for  the  oo-norm,  ;/(A)  +  ^|A2||  +  ^||fi||||Fl|-l-7,  = 
-0.18  with  \\xJ\  <  0.30.  Therefore,  it  follows  from  Theorem  5.2  that  the  delayed  bilinear 
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system  is  asymptotically  stable  when  the  initial  state  belongs  to  the  region  of  attraction 
which  is  at  least  ||xo||  <  0.9 1 . 

When  there  is  no  uncertainty  present,  the  results  are  even  better,  as  is  expected.  Using 
the  2-norm,  which  for  this  example  gives  the  largest  bound,  the  following  is 
obtained:  ^(A)  +  ^||A2||  +  |||fi||||F||  +  7,  =  -0.84  with  a  region  of  attraction  given  by||xo||  < 
1.41,  which  is  adequate  for  practical  applications.  It  should  be  noted  that  the  approach  of 
Lin  and  Saberi  (1993)  and  Sussmann,  et  al.  (1994)  developed  for  exactly  known  stable 
linear  systems  would  not  be  applicable  to  this  example  since  A  is  not  Hurwitz.  Also,  in 
Longchamp  (1980),  an  example  is  given  with  a  much  smaller  region  of  attraction  (\xf\  < 
0.255),  and  the  author  claims  that  it  is  large  enough  for  practical  applications. 

5.6  Conclusions 

This  chapter  establishes  sufficient  conditions  for  the  robust  stabilization  of  uncertain 
bilinear  systems.  The  results  presented  are  applicable  to  continuous  time  models  that 
include  delayed  states  as  well  as  nonlinear  uncertainty  descriptions  that  are  norm-bounded. 
An  example  has  been  given  that  illustrates  the  simplicity  as  well  as  the  effectiveness  of  the 
derived  robust  stability  conditions. 


CHAPTER  6 

DELAY-DEPENDENT  ROBUST  STABILITY  CONDITIONS-CSTR  WITH 

RECYCLE  STREAM 

6.1  Introduction 

Many  processes  have  dynamic  behavior  that  is  significantly  affected  by  time  delays 
due  to  transportation  lags  and  measurement  delays.  Systems  with  time  delays  are  known  to 
occur  in  diverse  areas.  Delays,  for  example,  are  inherent  in  a  variety  of  biochemical, 
optical  transmission,  electric  or  hydraulic  networks  and  photochemical  systems  (Scell  and 
Ross,  1986).  Two  types  of  time-delay  processes  can  be  distinguished.  Natural  time 
delays  such  as  those  occurring  in  biochemical  processes  and  medicine  in  which  transport  of 
reactants  across  a  membrane,  and  transmission  of  signals  by  the  circulation  of  hormones  or 
slow  transcription  of  ribonucleic  acid,  are  examples  of  events  that  can  induce  a  delayed 
outcome  on  regulation  of  reaction  paths.  Imposed  time  delays  caused  by  illuminated 
thermochemical  reactions  in  the  presence  of  delayed  feedback  and  reactors  which  recycle 
unreacted  feed  material  is  another  type  of  time-delay  process.. 

Chemical  process  control  systems  are  conventionally  designed  using  the  unit 
operations  approach.  That  is,  controllers  are  designed  for  each  piece  of  equipment  or  unit 
in  a  plant,  and  then  any  conflicts  between  control  loops  are  reconciled  (Stephanopoulos, 
1983).  As  Price  and  Georgakis  (1993)  demonstrate  in  their  plantwide  control  design 
framework,  two  of  the  candidate  structures  for  use  in  this  modular  control  procedure  are 
materials  recycle  and  the  chemical  reactor/separator  module,  both  of  which  may  introduce 
time  lags  in  the  model.  Both  operations  are  used  extensively  in  the  chemical  processing 
industry.  The  dynamics  and  stability  of  continuous  stirred  tank  reactors  (CSTR)  has  been 
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the  topic  of  numerous  publications  and  several  books  in  the  last  forty  years  (Aris  and 
Amundson,  1958).  Several  of  the  published  works  include  the  effects  of  a  recycle  stream 
on  the  dynamic  behavior  of  the  reactor.  Because  recycling  reduces  waste  of  reagents,  and 
hence  the  cost  of  reaction,  its  use  is  widespread  in  industry.  A  difficulty  though  with  much 
of  the  literature  on  recycling  is  that  the  model  almost  always  assumes  no  time  delay  in  the 
recycle  stream  (Uppal,  et  al,  1974).  This  means  that  the  separation  process  and  the  return 
time  to  the  reactor  is  assumed  to  be  instantaneous.  While  this  assumption  makes  the 
analysis  simpler,  it  is  highly  unrealistic.  The  process  of  recycling  requires  a  finite  amount 
of  time  which  introduces  a  delay  into  the  system  since  both  the  concentration  of  the 
reactants  and  the  temperature  in  the  reactor  depend  on  some  past  time. 

The  description  of  time-delay  systems  leads  to  differential-difference  equations,  the 
solutions  of  which  require  knowledge  of  past  values  of  the  system  variables.  The  response 
of  a  system  with  a  time  delay  can  be  quite  complex.  For  example,  studies  of  isothermal 
reactions  indicate  that  delayed  feedback  may  stabilize  unstable  stationary  states  or  may 
destabilize  an  already  stable  steady  state  (Inamdar,  et  al,  1991).  Other  phenomena  like 
multistationarity,  periodic  oscillations  and  chaos  are  possible  at  longer  time  delays.  From 
this  discussion,  it  is  evident  that  the  existence  of  time  delays  may  cause  major  difficulties  in 
the  design  and  implementation  of  control  and  can  deteriorate  the  system  performance.  A 
variety  of  dead-time  compensation  techniques  have  been  proposed.  Much  attention  has 
been  given  to  the  Smith  predictor  which  effectively  removes  the  time  delay  from  the 
characteristic  equation  if  the  process  model  is  perfect.  However,  it  is  well-known  that  this 
technique  can  give  unacceptable  closed-loop  responses  in  the  presence  of  plant/model 
mismatch  (Wong  and  Seborg,  1986). 

Because  the  introduction  of  time  delays  makes  the  analysis  much  more  complicated, 
convenient  methods  to  determine  stability  have  long  been  sought.  Lyapunov  theory  has 
played  a  central  role  in  the  stability  analysis  of  ordinary  dynamic  systems.  The  second 
method  of  Lyapunov  has  also  been  extended  to  deal  with  stability  analysis  of  time  delay 
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systems  (Hale  and  Lunel,  1993).  While  this  method  has  physical  meaning  in  certain  cases 
and  other  advantages;  until  recently,  there  has  not  been  general  systematic  procedures  to 
construct  the  appropriate  Lyapunov  function.  Also,  a  complicated  Lyapynov  matrix 
equation  may  not  be  a  trivial  task  to  solve.  Of  the  existing  stabilizing  approaches,  perhaps 
the  most  appealing  one  is  to  use  differential  inequality  techniques.  These  techniques  have 
features  useful  for  design,  and  have  been  used  to  analyze  ordinary  as  well  as  time-delayed 
systems  (Mori,  et  ai,  1981;  and  Mori,  1985).  Two  types  of  criteria  have  been  developed: 
(/)  conditions  that  are  independent  of  the  size  of  time  delay,  and  (//)  delay-dependent 
stability  criteria  (Chen,  et  ai,  1988).  For  an  extensive  list  of  references  and  discussion, 
see  Hale  and  Lunel  (1993)  and  Chen  and  Latchman  (1995). 

Although  linear  control  theory  has  a  wide  range  of  applicability,  there  are  always  some 
nonlinearities  that  must  be  considered  in  practice.  Actuators,  for  example,  have  physical 
limitations  and  saturation  may  result  in  their  operation.  If  such  nonlinearities  are  not  taken 
into  account  during  control  system  design,  integral  wind  up  or  limit  cycles  may  occur 
(Krikelis  and  Barkas,  1984).  The  stability  of  linear  systems  with  saturating  actuators  has 
been  studied  extensively  (Bitsoris  and  Vassilaki,  1995;  Bernstein  and  Michel,  1995); 
however,  most  of  the  stabilization  methods  proposed  so  far  are  not  directly  applicable  to 
time-delay  systems  with  series  nonlinearities.  There  are  few  reports  available  on  the  robust 
stabilization  of  time  delay  systems  with  input  saturation,  let  alone  chemical  reactors  with 
modeling  uncertainties.  Hence,  the  problem  of  designing  a  robust  controller  to  stabilize 
uncertain  CSTR  models  with  time  delay  and  series  nonlinearities  in  the  presence  of 
uncertainty  is  well  motivated. 

In  this  chapter,  the  stabilization  of  a  linear  model  of  an  integrated  reactor/separator 
module  with  recycle  is  studied.  Nikolaou  and  Hanagandi  (1994)  have  shown  that  there  are 
nonlinear  systems  that  are  virtually  linear  for  a  nonvanishingly  small  range  of  inputs  and 
others  that  can  be  approximated  by  linear  models.  In  this  work,  linear  time  delay  nominal 
models  are  used  with  system  nonlinearities  appearing  in  two  different  terms:  the  first  term 
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includes  perturbations  which  are  allowed  to  be  nonlinear  and/or  time-varying,  and  the 
second  term  represents  nonlinearities  in  the  input  channel.  The  latter  includes  input 
saturation  as  a  special  case.  The  chapter  is  organized  as  follows:  first,  the  mathematical 
model  of  the  chemical  reactor  with  recycle  is  developed  as  an  illustrative  example  of 
systems  that  include  delays  and  uncertainty.  For  any  given  plant  that  contains  delays  in  the 
state  variables  and  plant  uncertainty,  robust  stabilization  conditions  are  derived  in  Section 
3.  The  case  of  series  nonlinearities  is  considered  next  in  Section  4.  The  key  observation  is 
that  nonlinearities  and  plant  uncertainty  may  destabilize  the  time  delay  system.  An 
algorithm  to  find  a  robustly  stabilizing  feedback  matrix  is  given  in  Section  5  followed  by  an 
example  that  illustrates  the  findings  and  necessary  conclusions. 

6.2     Problem  Formulation 

Consider  a  continuous  stirred  tank  reactor  (CSTR)  in  which  a  first  order  reaction  A  -> 
B  occurs.  The  dimensionless  equations  describing  the  conservation  of  mass  and  energy  in 
the  CSTR  with  recycle  stream  are  given  by 


X2(0  =  /2W:= -^2(0  +  0- A);c2(f-;i)  +  BD„e'"^^*'"^(l-x,(r))-p(x2(f)-^2c(0)  (6.2) 


where  the  dimensionless  variables  x^  and  refer  to  the  extent  of  conversion  and  the 
temperature  in  the  reactor,  respectively.  The  remaining  dimensionless  groups  are  defined 
in  the  Notafion  secfion.  It  is  useful  to  remark  that  equaUons  (6.1)  and  (6.2)  require 
knowledge  of  past  values  of  variables  x,  and  Xj-  In  the  absence  of  time  delay,  but  with  the 
recycle  stream  still  operating,  equations  (6.1)  -  (6.2)  reduce  to 


u,(r-/z)  +  D„e'^^^""^(l-x,(0) 


(6.1) 


x,(t)  =  f,{x)  :=-x,(0  +  (l-A). 


XiitJ  =  -x^itJ  +  De 


(l-^,(^„)) 


(6.3) 


■^2(^«)  =  --^2(^«)  +  BDe 


(6.4) 
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where  r„  =  Xt,  D  =  DJX,  and  P„  =^/X.  Equations  (6.3)  -  (6.4)  are  the  well-known 
equations  for  a  CSTR  given  by  Uppal,  et  al.  (1974). 

Suppose  that  the  control  objective  is  that  of  regulating  the  extent  of  conversion  of  the 
reactant  {x^),  by  adjusting  the  temperature  of  the  cooling  stream  (u  =  XjJ.  Expanding  (6.3) 

-  (6.4)  in  a  Taylor  series  and  linearizing  around  a  steady-state  operating  point  a  linear  delay- 
differential  equation  in  matrix  form  i(0  =  Axit)  +  AjX{t  -  h)  +  bu{t)  results,  where  x  =  [x, 
^2VJ=  [/,/2F.  A  =  [dfldx\^,  A,=[cfldx{t-h)\^,2indib  =  [dfldu\^. 

When  designing  a  control  system,  one  should  take  into  account  modeling  uncertainties 
related  to  the  linearization  process  above,  or  originating  from  various  other  sources  such  as 
identification  error,  model  reduction  for  design  purposes,  variations  of  the  plant  parameters 
during  operation,  and  other  inaccuracies.  With  the  issue  of  robustness  being  of  particular 
importance  currently,  the  model  considered  in  the  present  work  is  given  by  the  state 
equation 

x{t)  =  Ax{t)  +  A,x{t  -h)  +  Bu{t)  +  g{x{t\t)  +  g,{x(t  -  h),t)  (5  5) 

and  belongs  to  the  class  of  uncertain  time-delay  systems  where  g(x(t),t)  and  gjx(t- 
h),t)  represent  nonlinear,  possibly  time-varying,  modeling  perturbations. 

6.3     Theoretical  Developments 

In  the  previous  section,  we  discussed,  through  an  example,  how  a  state-space  time 
delayed  model  can  be  derived  from  first  principles,  for  a  CSTR  with  recycle  stream.  Here, 
a  robust  stability  analysis  of  uncertain  systems  with  delay  in  the  state  variables  is 
developed.  It  is  assumed  that  there  are  no  constraints  on  the  manipulated  variable.  The 
robust  stability  analysis  in  the  presence  of  input  nonlinearities  is  deferred  for  the  next 
section. 

In  the  analysis  that  follows,  the  concept  of  the  matrix  measure  is  used  extensively. 
For  this  reason,  a  formal  definition  and  a  few  important  properties  are  given  next.  For  a 
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more  extensive  discussion,  the  reader  is  referred  to  the  excellent  book  by  Vidyasagar 
(1993). 

Definition  6.1.  The  matrix  measure  is  a  function  ji :  /?"""  R 

jiiA)  =  lim  — 

where  ||  •  ||  is  an  induced  matrix-norm  on  R'"" .  The  matrix  measure  is  also  known  in  the 
literature  as  logarithmic  derivative.  The  following  properties  are  of  relevance  here: 

(0  is  a  convex  function. 

07)   nidA)  =  5id{A),&nd 

{Hi)  Re  A(A )<  fiiA ) ,  where  A  is  any  eigenvalue  of  matrix  A. 

Consider  the  uncertain  linear  system  with  time-delay  in  the  state  represented  by  the 
equations 

xit)  =  Axit)  +  AjXit  -h)  +  Bu{t)  +  g[x{t),t)  +  g,{x{t  -  h),t) 
xie)=qKd)   ,  de[-h,0] 

yit)  =  Cxit)  (6.7) 
where  x(t)  e  i?"  is  the  state  vector  with  initial  state  x(0)  =  x^;  u(t)  e  R"^  is  the  input 
vector;  y(t)  e  R^  is  the  output  vector;  A,,  B,  and  C  are  constant  matrices  of  appropriate 
dimensions;  <p(t)  is  a  continuous  vector-valued  initial  function;  and  /z  >  0  is  the  time  delay. 
The  vector  functions  g(x(t),t)  e  /?"  and  gjx(t-h),t)  e  /?"  represent  nonlinear  modeling 
perturbations  that  depend  on  the  current  state  x(t)  and  the  delayed  state  x(t-h)  of  the 
system,  respectively.  No  statistical  information  is  required  about  the  uncertainty  vectors  g 
and  g^;  it  is  only  assumed  that  the  modeling  uncertainties  satisfy  the  following  norm- 
bounds: 

\\g{x{t),t)\\<k\\x(t)\\  (6.8) 

and 

\\g,{xit  -  h),t)\\<  kjxit  -  h)\\  (6.9) 
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where  k  and  are  a  priori  known  positive  real  constants,  and  the  operator  ||  •  ||  may  be  any 
appropriate  vector  norm. 

In  this  chapter,  a  state  feedback  control  law  of  the  form 

uit)  =  Fxit)  (6.10) 
where  F  is  a  constant  matrix,  is  used  to  derive  the  robust  stability  conditions.  The 
objective  can  be  stated  as  follows:  find  conditions  that  F  must  satisfy  in  order  to 
asymptotically  stabilize  the  closed-loop  (6.6)  -  (6.7)  and  (6.10)  for  all  modeling 
perturbations  that  conform  with  the  norm  bounds  (6.8)  -  (6.9).  Any  matrix  F  that 
stabilizes  the  uncertain  delayed  system  is  said  to  be  robustly  stabilizing.  It  should  be 
pointed  out  that  dynamic  output  feedback  compensation  is  also  possible  in  the  context  of 
this  approach,  but  is  not  attempted  here. 

Theorem  6.1:    Delay-dependent  robust  stability  conditions 

Suppose  that  the  plant  uncertainties  satisfy  conditions  (6.8)  and  (6.9)  and  the 
following  inequality  holds: 

-^(A+Aj)-k-kj-hM>Q  (6.11) 
where  A=A  +  BF  and  M  =  |a^A  ||  +  ||AjA J|+ +  A: J .  Then,  the  uncertain  time 

delayed  system  (6.6)  -  (6.7)  is  asymptotically  stable  under  state  feedback  control  given  by 
(6.10). 

The  proof  of  Theorem  6.1  is  contained  in  Section  6.5.  When  the  time  delay  h  is 
uncertain,  Theorem  6. 1  can  alternatively  be  stated  in  the  following  way  to  find  an  upper 
bound  on  h.  Let  the  feedback  (6. 10)  be  implemented  where  F  is  a  known  matrix,  and  then 
the  closed  loop  system  (6.6)  -  (6.7)  is  asymptotically  stable  if  the  delay  h  is  bounded  by 

Q<h<h  =  ~^^^^'^'''^~^~^''  (6.12) 
M 

which  is  simply  a  rearrangement  of  inequality  (6. 1 1). 


91 

Some  remarks  conceming  the  derived  conditions  follow: 

•  The  tightness  of  the  bound  in  (6.12)  or  (6.13)  varies  with  the  chosen  norm  and  the 
corresponding  matrix  measure  (Vidyasagar,  1993).  In  other  words,  it  is  possible  to 
determine  stability  with  a  given  norm  and  matrix  measure,  while  with  other  choices  the 
stability  condition  may  not  hold.  The  largest  bound  computed  for  the  1,  2,  or  infinity 
norms  should  be  selected. 

•  When  checking  the  asymptotic  stability  of  a  given  uncertain  delay  system,  one  should 
try  the  1  or  infinity  vector  norms  first,  dispensing  the  troublesome  eigenvalue  computations 
associated  with  the  2-norm.  The  freedom  in  choosing  a  suitable  norm  and  matrix  measure 
to  improve  the  stability  condition  resembles  that  of  constructing  an  appropriate  Lyapunov 
function  candidate  in  the  well-known  and  widely  used  Lyapunov  approach  for  determining 
stability. 

•  For  the  nominal  case  when  the  uncertainty  is  negligible  (that  is,  g  and  are  identically 
zero)  and  also  h  =  0,  inequality  (6.11)  of  the  theorem  reduces  to  //(A  +A^)<0  which 
implies  that  A  +  is  asymptotically  stable,  since  Re A(A  +Aj)<  /i(A  +Aj)<0.  When 
h^^O,  condition  (6.1 1)  simply  means  that  A+Aj  should  be  stable  enough  to  overcome  the 
difficulty  posed  by  the  time  delay  in  the  system.  It  is  thus  evident  that  time  delay  can 
destabilize  an  otherwise  stable  closed  loop. 

•  It  has  been  known  (Mori,  1985)  that  delay  independent  criteria  are  conservative  due  to 
lack  of  information  on  the  delay,  especially  when  delays  are  small.  It  is  then  reasonable 
when  checking  the  stability  of  uncertain  delay  systems  to  start  with  delay  independent 
criteria  and  if  they  fail  to  turn  to  delay-dependent  ones. 

•  Besides  the  well-known  1,  2,  and  infinity  norms,  other  induced  norms  and  matrix 
measures  involving  weighting  parameters  may  be  utilized  in  the  stability  conditions.  As  an 
example  consider  the  following  matrix  norm  and  corresponding  measure  (Strom,  1975  and 
Mori,  1981): 
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=  ^f^Y.f^h!\  '  ^M)  =  max^a,  +  X,„^7 (6. 13) 
Other  weighted  norms  can  be  defined  similarly.  Now,  a  simple  optimization  problem  with 
respect  to  the  arbitrary  weighting  factors  will  yield  less  conservative  robust  stability 
conditions.  This  is  a  topic  that  merits  further  investigation  and  is  not  pursued  further  in  this 
work. 

Corollary  6.1.  Consider  the  uncertain  time-delay  system  with  uncertain  matrices 
A ,  A  J,  and  B,  represented  by 

x{t)  =  (A  +  AA)x{t)  +  (A^  +  AAj  )x{t  -h)  +  {B  +  AB)u(t) 

x{d)  =  (pid)   ,    de[-h,0]  (6.14) 

where  the  matrix  perturbations  satisfy  the  norm  bounds 


||A4||<a,   |/i4j|<a^,   \\AB\\<  p  (6.15) 
Then,  the  closed-loop  system  is  asymptotically  stable  if 

Q^^^j^^ZE^llAAz^^Z^k^  (6.16) 

M 

where  the  denominator  M  in  this  case  is  given  by  M  =  ||AjA || -I- ||AjAj||-I-  ||A^||(«  +  CCj). 

Proof.  It  is  analogous  to  the  proof  of  Theorem  6. 1  and  follows  readily  after  invoking 
the  bounds  (6.15)  instead  of  (6.8)  -  (6.9).  (see  Section  6.5).  ♦ 

6.4     Robust  Stability  in  the  Presence  of  Input  Nonlinearities 

In  this  section,  a  stability  analysis  is  presented  for  time  delay  systems  affected  by 
nonlinearities  in  the  input  channel.  Prior  to  the  discussion  of  robust  stability,  some  useful 
concepts  are  depicted. 

Definition  6.2.  For  a  continuous  nonlinear  mapping  A^:  R""  /?"",  and  for  two  real 
numbers  p  and  q  such  that  ,  A'^  is  said  to  lie  inside  a  sector  [p,  q]  (see  Figure  2)  if  A'^ 
satisfies  the  following  two  properties: 


and 


A^(0)  =  0 


N{u{t))-P^u{t) 


< 


uit)\\ 
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(6.17) 

(6.18) 


where  (p  +  q)l2  is  the  center  of  the  sector  and  {q  -  p)l2  is  its  radius. 


sat  u  i  ^ 

\ 

u. 
I 

slope  =  q  ^ 

^■"-—-^  -  "  "   slope  =  p 

 > 

Ui 

Figure  6-1.  Actuator  saturation  with  bounds     and     and  sector  nonlinearity  [p,  q\ 

In  the  presence  of  input  nonlinearities,  the  uncertain  time  delay  system  becomes 
x{t)  =  Axi,t)  +  AjX{t-h)  +  BN{u(,t))  +  g{x{t),t)  +  gj{x{t-h),t) 

x(d)  =  <p(e)  ,  de[-h,o] 

From  equations  (6.19)  and  (6.10),  the  closed-loop  system  may  conveniently  be  represented 
as 


jc(0  =  Ax(t)  +  ^fl«(f)  +  A  jx(t  -h)  +  fi[iV(«(0)-  -^"(O] 
+  g{x{t),t)  +  gj{xit-h),t) 


(6.20) 


or 


m  =  Ax(t)  +  A,x(t  -h)  +  B[N{u{t))-  ^a(r)]+  g(jc(r),r)  +  ^,(jc(r -  h),t)  (6.21) 
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where  the  term  ^Bu{t)  has  been  added  and  subtracted  in  (6.20),  and  matrix  A  is 
defined  as  A  =  A+  BF .  Now,  proceeding  on  the  same  path  as  in  section  3,  the 
following  theorem  can  be  stated. 


Theorem    6.2.  Delay-dependent  conditions  in  the  presence  of  input 
nonlinearities 

Suppose  that  the  nonlinear  plant  perturbations  of  the  time-delay  system  (6.21)  satisfy 
(6.8)  -  (6.9).  Let  the  robust  state-feedback  matrix  F  be  chosen  to  satisfy  the  inequality 

-li(A  +  A,)-^\\BF\\  -k-kj-hM>0  (6.22) 

where  A^A+^^BF  and  M  =  ||A^A||-h||A^Aj|+||Aj|(^||fiF||-HA:-HA:^).    Then,  the 

uncertain  time  delay  system  (6.21)  is  asymptotically  stable  under  state  feedback  control. 

The  proof  of  Theorem  6.2  follows  that  of  Theorem  6.1,  and  is  contained  in  Section 
6.5.  Theorem  6.2  can  be  specialized  to  the  case  of  input  saturation.  For  example,  the 
classical  saturation  function  satu(t)  is  defined  as  follows  (see  Figure  1): 

sat  u{t)  =  [sat Uiit)  satu^it)...  sat u^(t)f  (6.23) 

where 

M,  ,    M,.  <  M, 

sat  Ui(t)  =  <       u-<u.<u-     ,   /  =  l,2,...,m  (6.24) 

and  where  m,  and  u,  are  real  scalars  representing  lower  and  upper  saturation  limits, 

respectively.  Then,  condition  (6.22)  is  still  applicable  with  matrix  A  defined  as 
A -A+^BF  and  M  =  \\AjA\\  +  [A^aJ-F ||Aj(^||fiF||  +  k  +  kj). 

A  simple  Design  Algorithm  is  outlined  bellow  to  assist  in  choosing  matrix  F. 
From  the  analysis  in  the  previous  sections,  an  iterative  procedure  can  be  proposed  for 
selecting  the  matrix  F  to  satisfy  the  robust  stability  conditions. 

Step  1:  Given  the  norm  bounds  of  the  plant  uncertainty,  select  distinct  negative 
eigenvalues  A,  /  =1,  2, ...  n.  for  the  matrix  A . 
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Step  2:  When  input  nonlinearities  are  known  to  lie  in  sector  [p,  q],  find  the  control 
matrix  F  using  a  standard  pole-placement  technique.  Check  whether  inequality 
(6.22)  is  satisfied.  If  so,  stop;  a  robust  matrix  F  has  been  obtained. 
Otherwise,  continue  on  to  Step  3. 

Step  3:  Shift  the  system  eigenvalues  to  the  left  using  A,  =  A„  -  AX,  i  =  1,  2.,.  n., 
where  AX,  >  0,  and  then  go  back  to  Step  2. 

From  the  inverse  point  of  view,  one  can  estimate  the  sector  where  the  input 
nonlinearities  must  lie  so  that  the  system  remains  asymptotically  stable.  In  such  a  case,  the 
first  step  of  the  algorithm  remains  the  same.  In  Step  2,  evaluate  condition  (6.12)  as  if  the 
nonlinearities  were  not  present.  If  inequality  (6.12)  is  satisfied  then  go  to  Step  4. 
Otherwise  continue  with  Step  3. 

Step  4:  From  inequality  (6.22)  and  the  equality  =  1,  find  variables  p  and  q  such 
that  the  input  nonlinearities  lie  in  the  sector  [p,  q].  The  uncertain  time-delay 
feedback  system  is  then  guaranteed  to  be  asymptotically  stable. 

Two  comments  are  in  order  here  concerning  the  suggested  iterative  procedure  for 
selecting  the  feedback  matrix  F. 

•  As  was  pointed  out  in  an  earlier  section  of  this  chapter,  the  present  formulation  can 
accommodate  uncertain  time  delays.  In  such  a  case,  inequality  (6.12)  should  be  used 
instead  of  inequality  (6.1 1)  in  the  above  design  procedure. 

•  In  step  2,  the  use  of  pole-placement  is  proposed  as  a  method  to  search  for  a  robust  state 
feedback  matrix  F.  This  choice  was  made  simply  for  convenience  and  clarity  of  exposition 
of  our  approach.  Other  techniques  that  include  eigenstructure  assignment,  receding 
horizon,  or  output  feedback  may  be  used  in  conjunction  with  the  formulation  of  the 
problem  presented  here  to  derive  robust  stability  conditions  for  uncertain  chemically 
reacting  systems  with  time  delays.  This  topic  merits  further  investigation  which  is  not 
undertaken  in  this  Dissertation. 
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6.5  Example 


This  section  demonstrates  the  applicability  of  the  robustness  conditions  developed  in 
earlier  sections  to  the  stabilization  of  the  Van  de  Vusse  reaction  scheme  (Van  de  Vusse, 
1964  and  Kantor,  1986). 

The  Van  de  Vusse  kinetics  are  characterized  by  the  irreversible  reactions 


which  take  place  in  an  isothermal  CSTR  with  recycle  stream.  The  mass  balances  for 
components  A  and  B  are  as  follows: 


The  control  design  problem  in  this  case  focuses  on  regulating  the  concentration  of 
component  B  (output  variable  y  =  Cb)  by  manipulating  the  inlet  flow  rate  (control  variable  u 
=  F).  Despite  its  simplicity,  the  Van  de  Vusse  reaction  scheme  displays  some  interesting 
behavior:  the  reactor  exhibits  a  change  in  gain  at  the  peak  conversion  level,  and  has 
nonminimum-phase  characteristics  for  operation  to  the  left  of  this  peak  and  minimum  phase 
characteristics  for  operation  to  the  right . 

Define  t  =  f  F/V  and  h  =  h!  F/V  as  the  dimensionless  time  and  time  delay, 
respectively.  Linearizing  about  the  steady  state  operating  point  (6.Cas,  Cbs  ,  F^),  and  then 
writing  all  variables  in  deviation  form,  obtain  the  following  time-delayed  model  for  the 
reactor: 


A  ^  B  ^  C, 


2A^D 


C,(f)  =  -k,C, 


if)-k,Cl{f)  +  X^C,^+{l-X)^C,{f-h')-^C,(t')  (6.25) 
V  V  V 


(6.26) 


x{t)  =  Ax(t)  +  AjX{t  -h)  +  Bu{t)  +  g{x{t),t)  +  gj{x(t  -  h),t) 


(6.27) 


where  x  =  (Q  C^f , 
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-L  —  -1 


0 


1-A 


0 


0 


1-A 


and 


B  = 


C 

Fs 


Nominal  values  for  the  physical  constants  of  the  model  and  the  operating  conditions 
are  given  in  Table  1  in  the  next  page.  The  recycle  ratio  is  taken  to  be  A  =  0.75,  and  the 
uncertainty  bounds  are  chosen  as  ^  =  A:d  =  0.25.  The  input  variable  is  saturated  as 
described  by  (6.23)  -  (6.24)  with  |m|  ^  1.  Also,  the  time  delay  h  is  not  exactly  known,  and 

we  seek  an  upper  bound  for  it. 

Use  of  a  standard  pole-placement  technique  (implemented  using  Matlab  routines), 
taking  the  eigenvalues  of  A  to  be  {-3.94  -3.58},  yields  the  feedback  matrix  F  =  [1.3 
0.2].  Then,  using  condition  (6.22),  the  upper  bound  on  the  time  delay  h  is  found  to  be: 

(0  For  the  1-norm  h=  1.96  min, 

(//)  for  the  2-norm  h=3  min,  and 

(///)  for  the  oo-norm  h=  1.81  min. 
Therefore,  for  the  specific  example  h  <3  min.  guarantees  the  asymptotic  stability  of  the 
system.  For  the  case  where  no  uncertainty  is  present,  the  best  upper  bound  on  /i  is  h=  3.9 
min.,  which  is  less  conservative  than  the  bound  h  =  2.7  min  obtained  using  the  delay- 
dependent  condition  of  Chen,  et  al.  (1988)  for  the  above  plant. 
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Table  1.  Kinetic  parameters  and  operating  variables  for  the  model  used  in  the  example 


kl 

50  h-' 

k2 

100  h  1 

k3 

10  L  mol-'  h  " 

10  mol  L-' 

V 

IL 

3.0  mol  L-' 

1.12  mol  L-> 

34.3  L  h-> 

Now  suppose  that  the  input  nonlinearities  lie  in  the  sector  [0.3  0.8]  and  the  time  delay 
is  known  to  be  /z  =  2.7  min.  Choose  the  feedback  matrix  to  be  F  =  [-2.81  -0.52]  which 
places  the  closed-loop  poles  at  {-4  -3.84}.  Then  using  the  1-norm  and  matrix  measure 
when  no  uncertainty  is  present,  inequality  (6.21)  yields  0.152  which  is  greater  than  zero; 
therefore  from  Theorem  6.2,  it  can  be  said  that  the  system  is  stable.  Evaluating  the  delay- 
dependent  condition  of  Chen,  et  al.  (1988)  yields  a  negative  number  (-0.037),  therefore 
nothing  can  be  concluded  about  the  stability  of  this  system. 

The  Nomenclature  that  has  been  used  in  the  example  and  throughout  the  present 
chapter  is  explained  below: 

B        Dimensionless  adiabatic  temperature  rise  |(-zi//)Q^^/pCp7^] 
Q      Reactant  concentration  in  the  CSTR 

Reactant  feed  concentration 
Cp      Specific  heat 


D„      Damkohler  number  [k"e~^V/ f) 

D       Damkohler  number  (D^,  /  A) 

E        Activation  energy 

F       Total  flow  rate  into  the  CSTR 

AH     Heat  of  reaction 

k"       Arrhenius  factor 

t  Time 

t„        Dimensionless  time  (r„F/ V) 
T        Reactor  tank  temperature 

Temperature  of  coolant 
Tf       Feed  temperature 
V        Reactor  volume 

X|       Dimensionless  concentration  [^(q^  -  Q^/c^^ 
Xi(t-h)  Dimensionless  concentration  jc,  at  time  t-h 
Xj       Dimensionless  temperature  [^^7  -  T^J^/ 7^  | 

Dimensionless  coolant  temperature  [(7^.  -  T)^/!^ 
Xjit-h)  Dimensionless  concentration  X2at  time  t-h 
h        Delay  time  for  recycle  stream 


The  following  Greek  Letters  have  also  been  used 

P  Dimensionless  heat  transfer  coefficient  [vAIFpCp^^ 

Pn  Dimensionless  heat  transfer  coefficient  (p/  X) 

^  Dimensionless  activation  energy  {^E/RT^^ 

X  Recycle  ratio 

A,  i-th  eigenvalue 

p  Density 
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6.6     Matrix  Measure  and  Theorem  Proof 


This  Section  contains  information  for  matrix  measure  computations  and  tlieorem 
proofs,  preceded  by  a  useful  lemma  used  in  the  proofs. 

For  the  usual  1,  2,  and  infinity  induced  norms,  the  matrix  measure  is  given  by  the 
simple  formulas  contained  in  the  table  that  follows.  The  induced  norms  are  also  included 
for  completeness. 

r  \ 

=  maxY\  a,j  I  .   f^AA)  =  max  a,,  +  ^\ a-j  I 

'    j  '  V      J*'  J 


=  max^\  a-j  I  ,    /X, (A)  =  max  a--  +  ^1  a--  I 


where  A^  is  the  transpose  of  matrix  A,  and  A^^^  denotes  the  maximum  eigenvalue. 

Lemma.  Let  a  scalar  function  f(t)  satisfy  the  inequality  f{t)  <  -ccf(t)  +  I5sup,_^^^^j(s) 
t  >  to,  where  a,  P  are  real  constants  such  that  a>  P>0.  Then,  there  exists  scalars  />  0 
and  >  0  such  that  f{t)<Kexp(-yit-tQ))  for  t  >  to.  (Hale  and  Lunel,  1993; 
Kolmanovskii  and  Nosov,  1986) 

Proof  of  Theorem  6.1.  Consider  the  initial  time  to  be  zero,  and  let  x(t),  be  the 
solution  of  (6.6)  for  t  >  0.  Since  x(t)  is  continuously  differentiable  for  t  >  0,  we  can  write 

x(0  -  x(t  -h)=\'  xis)ds 

h-h 

=  ['  [ Ajc(5)+  AjX{s  -  h)  +  Bu{s)  +  g{x{s),s)  +  gj{x{s  -  h),s)\ds 
Substitute  for  x(t-h),  in  (6.6.1)  to  obtain: 

xit)  =  (a  +  Aj)x(t)  -  A  J'  JAa:(5)+  AjX(s  -h)  +  Bu(s)  +  gix(s),s)  +  g/xis  -  h),s)]ds 
+  Bu{t)  +  g{xit),t)  +  g/x{t  -  h),t) 

(6.6.2) 


(6.6.1) 
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Using  «(0  =  Fx{t),  equation  (6.6.2)  becomes 

xit)  =  (A+  Aj)xit)  -  A  J'  JAx(5)+  AjX(s  -h)  +  g(xis),s)  +  g^ix{s  -  h),s)]ds  ^ 
+  gix{t),t)  +  g,ix{t-h),t) 
where  A  =A  +  BF .  The  solution  to  (6.6.3)  for  /  >  0  is  expressed  as  the  integral  equation 

x(t)  =  e'^'^''"xiO)+  r/<^+'*'' (-AAAxm+A,x(j}-h) 

•'°  ^  (6.6.4) 

+  (g{xm,  I?)  +  g,(jc(i?  -  h),  i?))]ji?  +  gixis),s)  +  g,ix{s  -  h),s)ds 

An  upper  bound  on  the  norm  of  the  solution  of  (6.6.3)  can  be  found  after  taking  the  norm 
of  both  sides  in  (6.6.4),  using  known  norm  properties  and  inequality  [Vidyasagar,  1993] 

|lAH|<^MA)r  ^>Q 


(6.6.5) 


to  yield 


\\xit)\\  <  sup  wxioy'^^"''"-'' + {y^^'^^'-'^j'  UA\\\mh - ^)ii 

-"^•^K  ^°  (6.6.6) 

+  ||Aj|(||^(x(z?),j?)|  +  ||g,(je(i?  - /z),  t?)||)]^/i?  +  ||g(x(5),5)||  +  ||g,(x(.  - 

Now,  use  the  plant  uncertainty  bounds  (6.8)  and  (6.9)  in  (6.6.6)  and  define 
X  :=  sup_i,^,J\xit)\\  to  obtain 

+  \\A,\\{k\\xm\\  +  k,\\xi^  -  h)\\)]dT»  +  k\\xis)\\  +  k,\\x(s  -  h)\\ds 
After  carrying  out  the  inside  integration,  inequality  (6.6.7)  can  be  written  as 
1^(01  <  Z/^^"^''^^'""^  +  ['/^^"^''^^^-"'/iM  sup  \\xm\\  +  k\\xis)\\  +  kM^-h)\\ds  (6.6.8) 
where  M  =  ||AjA||  +  ||AjAj||+||Aj||(A:  +  A:^).  Let  z(t)  e  R  be  the  trajectory  that  attains  the 
equality  sign  in  (6.6.8),that  is, 

||^(0||  =  ;^e'^<^^^''«'-'"+r.^*^^'^'^«^-'"/zM  sup  \\xm\\  +  kM  +  kM^-h)\\ds  (6.6.9) 
Then 

zit)  =  ^(A+A,)zit)  +  hM  sup  \\xm\\  +  k\\xit)\\  +  k,\\xit-h)\\  (6.6.10) 


(-2/i<i?</ 
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From  equations  (6.6.8)  and  (6.6.9)  it  is  obvious  that  ||jr(0||^  z{t)  for  t  >  0.  Hence, 

sup  ||jc(i?)||<   sup  z(j?) 

i-2h<i}<i  t-lh<d<t  (6  6  11) 

|^c(r-//)|l<z(r-/i)<  sup 

i-2h<i}<r 

After  substituting  (6.6.1 1)  in  (6.6.10),  the  following  differential  inequality  results: 

zit)<-(-fiiA+A,)-k)zit)  +  (hM  +  k,)  sup  zm  (6.6.12) 

r-2/i<i><r 

Then,  by  invoking  Lemma  1,  it  follows  that  z{t)  <  ATe"''""'",  that  is,  z(t)  is  asymptotically 
stable  if 

(-^{A+A,)-k)>(hM  +  kj)>0  (6.6.13) 

or  equivalently 

Q^^^ZM^A+A^^y-k-k^  (6.6.14) 
M 

which  concludes  the  proof. 

The  stability  degree  /satisfies  the  nonlinear  equation 

r  =  -^(A+A,)-k-(hM  +  k,)e^  (6  6^5) 

and  is  a  measure  of  the  decay  rate  of  the  solution,  that  is,  how  fast  jcfrj  converges  to  zero.* 

Proof  of  Theorem  6.2:  Let  x(t)  be  the  solution  of  (6.21)  for  t  >  0.  Since  x(t)  is 
continuously  differentiable  for  t  >  0,  we  can  write 

x{t)-xit-h)=  ['  x(s)ds=  f  \Ax(s)  +  A.x{s-h) 

+  B(N{uis))  -  ^«(5))  +  g{xis),s)  +  g,(xis  -  h),s)]ds      (6.6. 1 6) 

Substitute  foTx(t-h)  in  (6.21)  using  (6.6.16)  and  invoke  (6.10)  to  obtain: 

Ht)  =  (a  +  AMt)  -  A,  f  {Ax{s)+  A,x(s  -h)  +  b\n{u)  -  ^u]  +  g{x{s),s) 

'  ^'-'^  ^  ^  (6.6.17) 

+g/x{s  -  h),s)}ds  +  B[N{uit))  -  ^«(0]  +  gix{t\t)  +  g,ix(t  -  h),t) 
The  solution  to  (6.6.17)  for  r  >  0  is  given  by  the  integral  equation 
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xit)  =  e'^^'^'^xiO)  +  ly^'^'''''-''' l'j-A,)[Axm+  A,x(^  -  h)+  B[N{um)  -  ^u^] 

+(gixm,T})  +  -  h),i»))]di}  +  b[n{u{s))  -  ^uis)]  +  gixis),s)  +  g.ixis  -  h),s)ds 

(6.6.18) 

Then,  taking  the  norm  of  both  sides  in  (6.6.18)  and  using  inequalities  (6.18)  and  (6.6.5), 
we  obtain: 

\\xit)\\  <  sup  i^c(r)||/<^^"^>*'-"^  +  r  .(A.A,)(.-;,)|'  r(||^^ j||  +  iz£||Aj|||fiF||)|^c(t?)|l 

-h<r<h  ' 

+  ||A,A,|||^«:(i?  -  h)\\  +  \\A,\\(\\g{xm,n  +  Wgji^i^  -  h), (6.6. 1 8) 
+  £/(^-^.H-")[iz£||fiF||l^c(5)||  +  \\g{x{s),s)\  +  \\gAxis  -  h),s)ps 

Next,  use  the  plant  uncertainty  bounds  (6.8)  and  (6.9)  in  (6.6.18)  and  the  already 
defined  quantity  x  '=  ^^P-h<t<h\\'^(^%  obtain 

i^(r)ii  <  xe''^'^^''-'' + (Ml + ^\\A,\\\\BF\()\\x{n+ -  m 

+  \\A,\\{k\\xm\\  +  -  ht)\d^  +  (^ll^^ll  +  k)\K{s)\  +  k^s  "  h)\\ds 

(6.6.19) 

From  this  point  on,  proceeding  as  in  the  proof  of  Theorem  6.1,  inequality  (6.22)  readily 
follows  with  an  extra  term  appearing  in  the  denominator  M,  that  is,  the  quantity  -^HBFH  ♦ 


CHAPTER  7 

FURTHER  RESEARCH— IDEAS  AND  FUTURE  DIRECTIONS 


7.1       Mixed-Optimization  Approaches  to  Predictive  Control  Design 

In  modern  control  system  design,  the  specifications  may  be  such  that  enhanced 
performance  is  required  with  respect  to  multiple  measures,  which  should  therefore  be 
included  directly  into  the  design  process.  Such  considerations  have  led  researchers  to 
focus  on  the  design  of  controllers  to  satisfy  mixed  performance  criteria.  One  of  the 
problems  in  this  class  is  the  mixed  H^IH^  design  for  which  several  results  have  already 
been  published.  In  Chapter  3,  we  saw  how  the  design  of  robust  predictive  regulators  with 
adequate  performance  under  input  saturation  constraints  can  be  cast  as  a  mixed  ////^ 
problem.  In  that  approach,  the  /,  norm  is  used  to  ensure  satisfaction  of  the  constraints, 
while  robust  stability  is  guaranteed  through  methods. 

Motivated  by  the  above  discussion,  it  would  be  of  interest  to  investigate  the  design  of 
predictive  regulators  where  the  specifications  for  the  closed-loop  system  can  be  cast  as  a 
mixed  optimization  problem.  In  particular,  it  may  be  beneficial  to  formulate  and  solve 
mixed  problems  of  the  IJH^lype  or  the  most  recently  proposed  mixed  ////jand  //j//, 
optimization  problems  (Voulgaris,  1996).  We  propose  here,  a  two-stage  design  procedure 
for  synthesizing  predictive  controllers  that  satisfy  given  nominal  performance 
specifications,  and  are  robust  in  the  face  of  modeling  uncertainty.  The  first  stage  consists 
of  designing  a  predictive  controller  for  the  nominal  unconstrained  system  using  any  of  the 
currently  available  and  well  established  methods.  The  next  step  is  to  parametrize  the 
predictive  controller  with  respect  to  a  Youla  parameter  Q(z)  as  discussed  in  Chapters  2  and 
3.   In  the  second  stage,  the  design  is  optimized  in  order  to  satisfy  the  performance 
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specifications  (such  as  operational  constraints,  disturbance  rejection,  etc.),  and  to  achieve  a 
desirable  level  of  robustness  against  unstructured  perturbations. 

A  general  mixed-objectives  optimization  problem  for  the  second  stage  in  the  design  of 
robust  predictive  controllers  can  be  cast  as  the  following  optimization  problem: 

min  (piQiz))  (7.1) 

such  that 

\\R~{z)-Q{z)l<y  (72) 
where  (pi-)  is  a  performance  functional.  Clearly,  equation  (7.2)  yields  the  robustness 
condition  (11)  with  y<  1,  and  equation  (7.1)  addresses  the  nominal  performance 
requirements.  The  mixed-objective  problem  (7.1)  -  (7.2)  affords  systematic  solutions 
when  the  performance  functional  is  concave.  In  general,  the  performance  functional  may 
be  nondifferentiable.  The  explicit  form  of  the  functional  (p{  )  depends  on  the  design 
specifications.  In  particular,  (pi  )  can  take  the  form  of  a  system  or  signal  norm  as  discussed 
in  two  of  the  cases  of  interest  shown  below. 


UH„  Design: 


min  \\v(k)\\. 

QeHj^  (73) 


subject  to  (7.2),  where  v(k)  =  {viz)} ,  viz)  =  TJz;Q)diz),  and  where  TJz;Q) 
represents  the  transfer  function  between  signals  d(z)  and  v(z)  and  is  an  affine  function  of 
Q(z).  Note  that  the  signal  norm  is  the  maximal  time-domain  absolute  peak  of  the  signal. 
Hence,  in  this  formulation,  the  optimization  (7.3)  seeks  to  minimize  the  maximum 
amplitude  of  a  signal  v(k),  which  in  turn  depends  on  a  given  (known)  disturbance  signal 
d(k).  Cases  of  particular  interest  are  those  where  the  signal  v(k)  is  the  output  of  the 
controller  u(k)  or  of  the  process  y(k).  In  this  fashion,  input  and/or  output  saturation 
constraints  are  directly  addressed  in  the  IJH^  problem. 
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Hj/H^  Design: 

^  (7.4) 


subject  to  (7.2). 

The  optimization  problem  (7.4)  can  have  two  interpretations.  First,  from  a  stochastic  point 
of  view,  (7.4)  seeks  to  minimize  the  RMS  value  of  signal  v(k)  subject  to  a  white  noise 
disturbance  signal  d(k).  Second,  using  the  definition  (Dahleh  and  D.-Bobillo,  1995) 

another  interpretation  of  (7.2)  is  that  it  minimizes  the  maximum  amplitude  of  signal  v(k) 
subject  to  the  worst-case  energy  bounded  disturbance  d(k).  As  before,  interpreting  v(k)  as 
either  u(k)  or  y(k),  the  H/H^  design  method  permits  the  explicit  design  for  input  or  output 
constrained  systems. 

A  suboptimal  solution  to  a  mixed-objective  optimization  problem  of  the  form  (7.1)  - 
(7.2)  has  already  been  used  in  Chapter  3  where  we  solved  an  ////„  problem.  For  other 
problems  of  the  (7.1)  -  (7.2)  type,  the  numerical  tractability  of  the  optimization  needs  to  be 
examined.  If  they  are  solvable  (that  is,  convex),  then  the  kind  of  controllers  that  are 
obtained  is  of  great  interest.  For  example,  are  the  controllers  rational  and  of  what  order, 
and  how  good  is  their  closed  loop  performance  compared  to  conventional  designs? 


7.2       Robust  Predictive  Control  Design  for  Multivariable  Systems 

In  Chapters  2  and  3,  useful  methodologies  were  developed  for  the  design  of  predictive 
controllers  for  SISO  systems.  We  anticipate  that  the  design  techniques  developed  carry 
over  to  the  multivariable  case.  However,  such  an  extension  has  not  been  attempted  in  this 
dissertation.  It  should  be  pointed  out  here  that  generalization  of  the  GPC  technique  to  the 
multivariable  case  has  already  been  attempted  by  several  researchers  (Kouvaritakis  and 
Rossiter,  1993;  Kouvaritakis  et  al.,  1996).  No  robustness  studies  have  been  carried  out 
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though  for  multivariable  GPC,  up  to  the  completion  of  this  dissertation.  It  is  of  great 
interest  therefore  to  extend  the  results  of  Chapters  2  and  3  to  the  multivariable  case. 

7.3     Delay-Dependent  Stability  Conditions  for  Bilinear  Systems 

Another  important  future  research  topic  is  related  to  the  results  reported  in  Chapters  4 
and  5.  There,  the  stability  of  uncertain  bilinear  systems  with  saturating  actuators  is 
investigated,  and  sufficient  conditions  are  derived  through  the  use  of  linear  state-feedback. 
The  stability  conditions  of  Chapter  5  were  independent  of  the  size  of  the  time  delay  in  the 
state.  This  may  introduce  unnecessary  conservativeness.  We  propose  to  find  conditions 
for  robust  stabilization  of  bilinear  time-delay  systems  that  depend  on  the  magnitude  of  the 
delay  or  an  upper  bound  of  it.  Also,  the  stability  of  linear  and  bilinear  systems  with  delay 
in  the  control  variables  is  worth  investigating.  We  expect  that  the  results  reported  in 
Chapters  5  and  6  should  carry  over  to  the  delayed  input  case.  Although  much  research  has 
been  reported  over  the  past  decade  on  the  stabilization  of  linear  time-delay  systems,  results 
for  nonlinear  or  bilinear  systems  with  delays  are  almost  nonexistent.  We  anticipate  that  the 
use  of  matrix  measures  in  conjunction  with  linear  feedback  may  yield  sufficient  conditions 
that  parallel  those  of  Chapter  5.  An  alternative  approach  would  be  to  use  Lyapunov 
functions  to  guarantee  the  stability  of  the  time-delay  system.  Finally,  other  future 
extensions  include  the  use  of  output  feedback  or  dynamic  compensators  and  the 
incorporation  of  observers  when  the  states  are  not  measurable. 

7.4     Robust  Nonlinear  Feedback  Control  of  Bilinear  Systems 

Another  possible  venue  to  the  stabilization  of  uncertain  bilinear  systems  is  to  use  a 
nonlinear  feedback  approach.  The  stability  of  bilinear  systems  described  by  exact  models 
under  nonlinear  feedback  control  has  received  attention  in  the  literature,  and  a  few  methods 
have  been  reported  (Benalou,  et  ai,  1988;  Mohler,  1991).  We  propose  to  investigate 
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possible  extensions  of  these  results  to  the  case  where  the  bilinear  model  is  uncertain  and/or 
includes  time  delays.  Following  Lyapunov  stability  arguments  and  the  recently  developed 
theory  of  linear  matrix  inequalities  (LMI),  one  may  be  able  to  derive  stability  conditions  that 
can  be  verified  by  solving  a  set  of  LMIs.  It  should  be  stressed  here  that  if  successful,  the 
derived  conditions  will  guarantee  the  asymptotic  stability  of  the  closed  loop  globally  and 
not  only  at  a  restricted  region  around  the  origin. 

7.5     Bilinear  Predictive  Control 

A  very  promising  research  venue  is  to  formulate  and  solve  the  problem  of  designing 
predictive  controllers  using  a  bilinear  model  for  the  process,  and  derive  stability  guarantees 
for  the  closed  loop.  Successful  completion  of  this  endeavor  would  open  the  door  for 
robustness  studies  of  bilinear  predictive  systems.  Furthermore,  the  inclusion  of  input 
and/or  output  constraints  would  make  the  method  extremely  appealing  for  process  control 
applications. 

7.6     Variable  Structure  Control  for  Delayed  Systems 

The  sliding  mode  in  Variable  Structure  Control  (VSC)  possesses  well-known  features 
that  make  it  very  attractive  for  control  systems  design.  These  include  fast  response, 
insensitivity  to  parameter  variations,  decoupling  design  procedure,  etc.  (DeCarlo,  et  ai, 
1988).  Recently,  Shyu  and  Yan  (1993),  and  Oucheriah  (1995)  have  used  VSC  to 
guarantee  the  stability  of  uncertain  delay  systems,  deriving  sufficient  conditions  that  depend 
on  the  size  of  the  delay.  However,  the  Shyu  and  Yan  method  suffers  from  the  fact  that 
their  controller  synthesis  involves  unknown  matrices.  Oucheriah  proposes  a  dynamic 
switching  surface-control  scheme  based  on  pole-assignment.  Both  the  above  approaches 
involve  strong  discontinuous  control  across  the  switching  surface  to  overcome  the 
uncertainty  and  hence  suffer  severe  chattering  as  can  be  seen  also  in  their  figures. 


109 


Chattering  might  excite  the  unmodeled  high-frequency  components  of  the  system  and  may 
lead  to  excessive  wear  and  tear  of  the  actuators.  To  avoid  chattering,  the  recent  technique 
(Chan,  1996)  of  perturbation  compensation  can  be  employed  to  address  the  problem  of 
stabilizing  a  delay  system  via  VSC.  We  propose  to  use  a  VSC  design  methodology  to 
robustly  stabilize  an  uncertain  time-delay  system  with  nonlinear  and  possibly  mismatched 
uncertainties,  utilizing  the  concept  of  perturbation  compensation.  This  would  lead  to 
sufficient  robust  stability  conditions  that  are  independent  of  the  size  of  the  delay. 
Furthermore,  it  is  expected  that  no  matching  conditions  on  the  uncertainty  need  to  be 
assumed.  The  advantages  of  such  a  method  over  previously  published  methods  would  be: 
(/)  realizable  control  synthesis  that  does  not  include  unknown  matrices,  (//)  chattering 
reduction/ehmination,  and  (///)  delay-independent  robust  stability  conditions  which  can  also 
accommodate  uncertainty  in  the  delay. 
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